-- Logs begin at Thu 2022-05-12 14:43:42 UTC, end at Thu 2022-05-12 15:55:58 UTC. -- May 12 15:27:47.349048 dv-cinder-835881-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 15:27:47.356605 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 15:27:47 2022] *** May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: nodename: dv-cinder-835881-11-iscsi May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: machine: x86_64 May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: clock source: unix May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: pcre jit disabled May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: detected number of CPU cores: 4 May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: current working directory: / May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: detected binary path: /usr/bin/uwsgi-core May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: your processes number limit is 47680 May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: your memory page size is 4096 bytes May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: detected max file descriptor number: 2048 May 12 15:27:47.358625 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: lock engine: pthread robust mutexes May 12 15:27:47.359560 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: thunder lock: enabled May 12 15:27:47.359560 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 15:27:47.359560 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 15:27:47.404000 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: Python main interpreter initialized at 0x55815a1979c0 May 12 15:27:47.404000 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: python threads support enabled May 12 15:27:47.404000 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: your server socket listen backlog is limited to 100 connections May 12 15:27:47.404000 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: your mercy for graceful operations on workers is 90 seconds May 12 15:27:47.404418 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: mapped 403077 bytes (393 KB) for 2 cores May 12 15:27:47.404418 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: *** Operational MODE: preforking *** May 12 15:27:47.404741 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: *** uWSGI is running in multiple interpreter mode *** May 12 15:27:47.404741 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: spawned uWSGI master process (pid: 102800) May 12 15:27:47.404952 dv-cinder-835881-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 15:27:47.408100 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: spawned uWSGI worker 1 (pid: 102801, cores: 1) May 12 15:27:47.408100 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: spawned uWSGI worker 2 (pid: 102802, cores: 1) May 12 15:27:47.408100 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 15:27:48.586812 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 15:27:48.602226 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 15:27:49.304525 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:27:49.304525 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: from cryptography.utils import int_from_bytes May 12 15:27:49.304912 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:27:49.304912 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: from cryptography.utils import int_from_bytes May 12 15:27:49.305540 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:27:49.305540 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: from cryptography.utils import int_from_bytes May 12 15:27:49.305868 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:27:49.305868 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: from cryptography.utils import int_from_bytes May 12 15:27:51.892247 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 15:27:51.892869 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 15:27:51.892964 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 15:27:51.892964 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 15:27:51.893374 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 15:27:51.893374 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 15:27:51.893517 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 15:27:51.893584 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 15:27:51.893719 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 15:27:51.893876 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.893972 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 15:27:51.894183 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.894321 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.894531 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.894678 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.894855 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895009 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895186 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895332 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895474 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895579 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895813 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.895958 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.896174 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.896321 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.896420 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.896570 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.896786 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.896932 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897033 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897122 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897351 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897507 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-11-iscsi {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897639 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897777 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-11-iscsi {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.897945 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.898045 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.898315 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.898456 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.898636 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.898751 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.898941 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.899056 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.899258 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.899374 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.899562 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.899705 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.899901 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.900054 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.900611 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.900750 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.900856 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.900959 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901071 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901177 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901466 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901550 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901618 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901731 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.901883 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.902138 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.902221 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.902355 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.902492 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.902678 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.902813 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903005 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903151 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903326 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903471 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903715 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-11-iscsi {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903849 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-11-iscsi {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.903990 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.904091 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.904331 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.904499 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.904677 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.904810 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905085 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905239 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905427 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905681 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905824 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.905999 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.906148 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.906317 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.906517 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.906631 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.906850 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.906950 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.907172 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.907270 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.907491 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.907589 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.907806 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.907905 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.908120 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.908212 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.908413 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.908603 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.908744 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.908836 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909039 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909143 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909334 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909500 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909645 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909842 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.909942 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.910232 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.910366 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.910534 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.910639 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.910854 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.910948 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.911180 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.911276 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.911433 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.911523 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.911684 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.911837 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912005 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912109 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912325 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912419 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912659 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912759 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.912968 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913057 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913274 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913378 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913577 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913662 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913905 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.913997 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.914211 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.914304 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.914514 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.914620 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.914820 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.914925 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.915117 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.915202 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.915421 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.915515 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.915742 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.915830 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.916046 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.916139 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.916362 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.916453 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.916691 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.916788 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917007 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917102 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917311 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917405 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917636 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917729 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.917942 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918029 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918251 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918568 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918667 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918868 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.918960 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.919177 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.919273 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.919480 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.919614 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.919780 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.919914 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920082 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920179 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920385 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920506 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920716 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920816 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.920967 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.921055 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.921636 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.921734 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.921918 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922054 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922217 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922313 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922520 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922614 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922821 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.922916 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.923124 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.923212 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.923424 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.923516 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.923725 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.923820 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924017 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924113 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924319 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924412 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924652 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924756 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.924950 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925044 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925252 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925337 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925550 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925644 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925854 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.925946 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.926154 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.926246 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.926455 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.926554 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.926756 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.926843 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927058 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927151 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927361 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927460 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927662 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927748 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.927962 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928059 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928262 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928363 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928590 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928681 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928893 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.928978 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.929197 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.929299 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.929551 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.929679 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.929857 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.929980 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.930176 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.930275 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.930481 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.930569 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.930786 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.930882 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931097 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931192 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931395 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931487 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931699 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931798 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.931997 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.932133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.932300 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.932395 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.932628 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.932732 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.932932 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933020 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933235 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933322 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933533 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933626 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933832 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.933918 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.934129 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.934215 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.934428 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.934514 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.934723 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.934817 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935019 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935104 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935317 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935416 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935635 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935722 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.935937 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.936023 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.936243 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.936346 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.936592 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.936726 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.936926 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.937034 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.937259 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.937365 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:27:51.937591 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.937694 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.937904 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.937999 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.938240 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.938357 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.938550 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.938645 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.938874 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.938967 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.939201 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.939303 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.939502 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.939597 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.939816 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.939910 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.940125 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.940212 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.940436 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.940539 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.940768 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.940855 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.941078 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.941165 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.941389 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.941487 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.941707 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.941823 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942025 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942113 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942344 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942435 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942657 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942749 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.942966 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943053 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943283 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943376 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943590 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943675 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943906 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.943994 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.944213 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.944300 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.944563 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.944666 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.944877 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.944972 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.945251 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.945347 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.945642 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.945740 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.945958 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946057 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946280 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946368 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946611 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946717 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946897 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.946990 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.947207 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.947294 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.947514 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.947614 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.947833 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.947919 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.948156 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.948251 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.948464 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.948565 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.948805 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.948893 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.949113 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.949198 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.949422 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.949510 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.949726 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.949812 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950035 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950125 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950343 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950434 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950663 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950749 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.950972 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951058 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951284 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951379 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951589 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951675 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951898 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.951985 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.952203 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.952331 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.952534 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.952625 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.952842 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.952943 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.953148 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.953243 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.953449 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.953535 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.953750 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.953849 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954054 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954147 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954357 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954450 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954670 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954765 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.954992 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.955079 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.955296 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.955395 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.955606 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.955702 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.955913 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956006 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956221 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956313 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956547 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956637 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956856 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.956942 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.957163 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.957250 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.957466 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.957555 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.957772 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.957857 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958076 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958163 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958382 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958470 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958692 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.958995 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.959081 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.959301 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.959398 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.959602 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.959700 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.959905 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960042 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960212 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960341 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960535 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960626 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960892 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.960998 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.961215 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.961303 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.961532 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.961621 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.961841 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.961937 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.962148 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.962242 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.962461 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.962554 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.962780 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.962873 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.963103 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.963197 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.963405 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.963505 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.963727 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.963823 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964027 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964338 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964435 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964665 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964754 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.964967 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965052 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965265 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965350 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965568 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965657 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965870 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.965963 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.966174 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.966260 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.966474 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.966570 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.966773 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.966860 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967073 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967174 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967371 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967468 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967672 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967758 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.967979 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.968079 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.968299 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.968385 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.968606 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.968707 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.968909 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969006 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969209 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969298 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969546 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969640 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969852 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.969958 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.970181 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.970275 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.970507 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.970619 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.970819 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.970925 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.971128 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.971223 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.971432 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.971525 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.971739 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.971833 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972044 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972140 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972350 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972437 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972678 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972766 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.972990 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.973089 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.973303 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.973398 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.973608 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.973705 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.973921 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974014 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974227 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974323 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974543 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974630 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974844 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.974929 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.975157 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.975253 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.975457 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.975542 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.975767 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.975854 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.976103 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.976203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.976448 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.976599 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.976783 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.976887 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.977099 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.977196 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.977406 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.977493 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.977714 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.977800 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978029 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978204 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978324 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978411 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978629 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978721 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.978936 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979026 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979246 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979334 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979550 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979637 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979861 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.979948 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.980164 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.980250 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.980507 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.980626 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.980812 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.980917 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.981118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.981214 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.981417 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.981515 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.981727 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.981823 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982049 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982136 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982355 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982449 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982671 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982764 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.982979 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983072 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983288 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983384 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983592 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983685 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983896 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.983981 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.984199 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.984293 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.984520 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.984610 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.984828 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.984928 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.985135 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.985231 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.985446 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.985532 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.985749 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.985845 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986058 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986153 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986360 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986447 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986661 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986760 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.986965 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987060 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987263 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987348 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987575 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987662 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987875 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.987962 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.988192 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.988277 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.988516 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.988604 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.988835 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.988923 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.989138 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.989226 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.989436 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.989521 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.989738 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.989833 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990043 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990129 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990347 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990443 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990646 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990732 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.990948 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.991037 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.991253 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.991348 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.991570 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.991656 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.991885 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992001 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992249 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992346 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992584 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992676 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992900 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.992988 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.993205 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.993303 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.993508 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.993602 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.993811 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.993897 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.994118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.994207 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.994421 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.994507 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.994734 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.994822 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995037 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995124 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995344 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995430 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995647 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995732 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.995954 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.996043 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.996262 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.996348 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.996601 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.996701 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.996909 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997004 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997211 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997297 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997513 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997612 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997817 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.997904 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.998123 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.998394 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.998481 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.998729 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.998981 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.999068 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.999312 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.999401 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.999623 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.999723 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:51.999939 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.000027 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.000257 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.000352 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.000619 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.000765 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.000927 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.001051 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.001234 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.001334 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.001545 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.001633 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.001851 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002024 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002158 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002244 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002461 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002552 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002763 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.002903 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003065 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003152 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003364 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003450 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003666 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.003964 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004062 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004266 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004354 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004589 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004680 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004892 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.004980 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.005192 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.005279 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.005494 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.005581 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.005801 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.005900 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.006101 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.006188 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.006409 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.006496 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.006709 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.006805 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007009 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007096 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007313 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007409 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007640 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007739 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.007959 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.008054 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.008260 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.008356 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.008620 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.008712 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.008921 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009020 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009254 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009349 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009567 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009653 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009873 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.009971 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.010193 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.010280 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.010496 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.010583 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.010802 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.010891 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.011102 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.011187 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.011403 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.011491 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.011704 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.011804 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012007 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012094 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012308 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012394 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012631 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012721 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.012941 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013027 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013245 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013331 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013544 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013632 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013846 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.013932 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.014146 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.014242 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.014450 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.014538 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.014750 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.014838 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015051 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015147 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015350 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015436 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015650 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015737 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.015950 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016252 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016340 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016582 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016673 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016884 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.016985 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.017190 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.017278 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.017490 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.017586 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.017791 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.017885 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018090 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018183 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018390 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018478 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018688 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018782 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.018987 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019073 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019289 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019375 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019589 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019677 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019889 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.019983 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.020193 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.020281 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.020502 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.020638 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.020807 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.020895 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.021108 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.021203 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.021404 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.021491 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.021705 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.021791 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022010 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022106 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022309 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022396 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022617 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022705 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.022919 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.023014 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.023262 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.023352 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.023566 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.023654 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.023873 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024000 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024210 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024299 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024534 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024627 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024840 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.024930 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.025137 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.025224 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.025436 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.025523 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.025737 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.025838 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026038 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026125 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026340 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026426 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026645 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026734 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.026943 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027028 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027243 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027337 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027543 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027643 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027883 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.027977 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.028184 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.028285 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.028544 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.028632 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.028865 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.028953 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.029175 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.029271 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.029482 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.029568 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.029787 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.029873 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.030087 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.030299 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.030390 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.030479 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.030710 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.030799 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031000 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031106 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031300 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031386 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031604 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031692 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031901 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.031996 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.032201 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.032288 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.032532 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.032623 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.032847 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.032936 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.033154 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.033241 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.033471 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.033557 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.033772 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.033859 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034078 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034177 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034380 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034465 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034685 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034782 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.034988 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035081 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035292 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035390 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035597 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035693 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035899 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.035995 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.036205 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.036302 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.036538 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.036626 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.036849 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.036945 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.037153 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.037250 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.037461 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.037549 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.037767 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.037855 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.038077 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.038175 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.038398 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.038487 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.038698 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.038810 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039026 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039122 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039335 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039437 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039638 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039726 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.039950 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.040038 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.040250 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.040336 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.040585 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.040700 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.040892 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.041012 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.041314 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.041399 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.041616 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.041712 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.041920 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042013 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042224 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042312 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042533 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042620 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042840 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.042937 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.043145 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.043238 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.043454 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.043548 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.043758 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.043846 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.044155 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.044241 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.044484 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.044593 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.044793 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.044881 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.045097 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.045186 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.045399 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.045499 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.045703 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.045791 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.046013 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.046108 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.046678 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.046774 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.046983 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047069 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047287 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047382 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047587 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047678 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047905 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.047991 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.048205 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.048338 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.048549 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.048676 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.048964 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.049064 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.049272 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.049383 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.049574 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.049692 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.049985 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.050091 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.050295 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.050384 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.050604 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.050693 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.050925 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051019 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051231 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051326 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051544 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051655 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051843 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.051931 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.052155 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.052251 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.052464 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.052604 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.052811 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.052907 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.053126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.053221 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.053434 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.053538 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.053742 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.053835 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.054045 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.054133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.054363 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.054699 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.054829 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.054938 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.055078 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.055168 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.055401 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.055500 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.055734 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.055821 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.056057 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.056152 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.056382 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.056510 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.056716 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.056804 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057023 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057111 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057335 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057426 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057635 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057722 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.057945 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058032 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058252 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058340 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058554 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058643 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058864 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.058950 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.059170 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.059257 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.059477 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.059563 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.059782 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.059879 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.060087 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.060174 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.060393 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.060506 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.060721 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.060826 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061039 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061127 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061339 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061435 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061662 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.061974 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062069 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062277 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062372 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062598 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062696 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062904 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.062991 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.063211 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.063300 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.063518 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.063612 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.063820 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.063907 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.064120 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.064213 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.064419 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.064572 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.064786 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.064874 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.065090 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.065200 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.065411 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.065500 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.065734 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.065821 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.066060 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.066147 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.066369 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.066475 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.066689 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.066775 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067009 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067110 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067333 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067426 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067634 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067721 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.067945 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068046 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068243 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068328 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068570 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068673 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068876 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.068973 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.069177 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.069263 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.069480 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.069576 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.069780 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.069920 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.070138 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.070238 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.070442 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.070531 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.070744 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.070834 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071043 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071187 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071361 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071486 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071661 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071791 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.071963 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072050 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072268 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072355 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072593 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072697 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072904 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.072993 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.073203 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.073298 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.073540 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.073636 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.073839 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.073926 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.074168 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.074263 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.074476 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.074562 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.074789 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.074883 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.075109 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.075204 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.075416 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.075504 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.075727 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.075814 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.076041 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.076137 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.076354 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.076441 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.076690 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.076791 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077003 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077168 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077311 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077397 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077618 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077705 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.077928 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.078076 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.078234 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.078330 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.078544 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.078632 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.078855 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.079065 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.079154 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.079396 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.079677 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.079764 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080007 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080097 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080316 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080403 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080648 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080736 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.080960 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081053 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081272 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081368 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081578 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081673 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081884 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.081971 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.082188 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.082275 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.082495 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.082593 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.082805 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.082894 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.083128 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.083216 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.083446 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.083541 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.083764 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.083851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.084076 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.084164 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.084390 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.084563 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.084722 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.084808 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.085032 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.085120 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.085342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.085432 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.085686 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.085777 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086023 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086120 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086338 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086434 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086652 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086781 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.086962 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087059 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087270 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087356 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087577 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087663 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087882 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.087970 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.088190 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.088277 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.088518 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.088610 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.088830 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.088919 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.089136 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.089231 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.089454 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.089543 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.089763 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.089852 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.090084 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.090180 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.090393 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.090487 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.090705 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.090792 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.091012 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.091105 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.091322 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.091520 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.091616 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.091833 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.092133 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.092233 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.092443 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.092604 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.092794 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.092890 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.093117 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.093275 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.093431 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.093529 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.093742 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.093837 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094048 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094134 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094352 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094441 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094655 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094742 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.094957 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095045 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095259 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095353 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095559 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095645 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095860 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.095947 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.096164 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.096253 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.096508 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.096598 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.096795 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.096948 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.097128 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.097326 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.097436 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.097679 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.097963 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.098060 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.098308 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.098397 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.098619 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.098714 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.098934 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099031 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099242 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099330 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099558 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099643 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099862 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.099957 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.100169 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.100264 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.100488 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.100616 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.100794 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.100893 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.101097 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.101184 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.101430 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.101528 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.101739 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.101871 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102045 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102135 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102346 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102434 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102655 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102752 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.102960 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103268 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103356 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103571 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103660 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103874 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.103961 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.104183 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.104272 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.104496 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.104586 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.104805 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.104893 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.105109 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.105208 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.105410 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.105497 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.105710 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.105797 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106013 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106107 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106314 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106408 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106618 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106712 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.106919 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107015 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107222 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107309 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107523 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107610 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107832 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.107928 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.108132 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.108220 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.108437 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.108543 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.108802 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.108891 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.109107 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.109204 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.109406 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.109494 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.109708 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.109797 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110019 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110106 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110326 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110414 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110638 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110727 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.110940 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.111027 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.111247 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.111334 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.111589 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.111792 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.111918 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.112123 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.112414 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.112532 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.112767 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.112856 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.113087 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.113183 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.113394 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.113555 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.113701 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.113790 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114009 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114142 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114311 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114407 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114617 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114705 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.114924 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115011 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115232 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115538 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115632 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115840 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.115934 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.116145 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.116242 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.116447 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.116594 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.116776 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.116878 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.117137 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.117226 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.117446 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.117534 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.117757 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.117853 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118065 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118152 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118371 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118460 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118678 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118774 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.118990 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.119079 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.119318 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.119404 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.119630 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.119725 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.119941 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120036 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120248 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120342 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120587 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120691 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120897 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.120984 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.121203 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.121298 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.121509 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.121643 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.121815 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.121911 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.122127 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.122218 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.122431 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.122519 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.122760 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.122846 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.123068 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.123155 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.123449 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.123537 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.123771 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.123859 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.124082 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.124179 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.124396 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.124594 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.124730 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.124819 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125039 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125135 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125355 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125441 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125662 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125759 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.125982 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.126080 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.126288 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.126383 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.126614 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.126703 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.126933 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127022 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127241 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127329 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127545 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127632 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127854 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.127942 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.128155 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.128242 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.128457 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.128578 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.128781 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.128870 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129081 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129176 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129385 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129483 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129684 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129770 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.129984 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130071 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130287 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130387 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130587 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130674 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130888 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.130983 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.131184 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.131280 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.131483 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.131571 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.131783 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.131869 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.132083 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.132179 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.132378 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.132465 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.132765 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.132854 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133072 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133172 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133374 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133461 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133674 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133761 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.133975 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134063 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134272 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134368 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134575 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134670 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134871 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.134958 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.135169 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.135256 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.135466 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.135552 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.135793 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.135882 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.136120 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.136213 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.136426 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.136549 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.136768 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.136858 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.137076 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.137162 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.137387 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.137487 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.137694 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.137789 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138007 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138094 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138315 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138412 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138649 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138736 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.138960 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139049 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139271 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139368 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139580 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139675 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139886 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.139972 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.140192 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.140280 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.140512 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.140603 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.140822 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.140911 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.141130 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.141225 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.141451 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.141538 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.141769 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.141856 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.142074 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.142173 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.142439 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.142579 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.142702 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.142798 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143010 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143097 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143320 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143406 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143625 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143721 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.143936 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144024 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144243 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144329 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144572 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144674 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144882 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.144968 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.145188 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.145282 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.145494 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.145591 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.145805 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.145893 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.146116 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.146205 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.146435 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.146531 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.146755 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.146843 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.147077 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.147166 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.147400 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.147487 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.147740 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.147834 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.148050 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.148137 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.148396 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.148504 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.148736 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.148823 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.149044 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.149144 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.149292 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102802) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 15:27:52.149380 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.149663 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:27:52.149905 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 15:27:52.173902 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_db.sqlalchemy.engines [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.175453 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_db.sqlalchemy.engines [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.235770 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.context [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f87d5b30-e042-4499-b98c-f99906a2836c(cell1) {{(pid=102801) load_cells /opt/stack/nova/nova/context.py:464}} May 12 15:27:52.236968 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.context [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f87d5b30-e042-4499-b98c-f99906a2836c(cell1) {{(pid=102802) load_cells /opt/stack/nova/nova/context.py:464}} May 12 15:27:52.240188 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_concurrency.lockutils [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:27:52.241278 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:27:52.241796 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_concurrency.lockutils [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:27:52.242639 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_concurrency.lockutils [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:27:52.242903 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:27:52.243663 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:27:52.244529 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_concurrency.lockutils [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:27:52.245636 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:27:52.256325 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_db.sqlalchemy.engines [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.260110 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_db.sqlalchemy.engines [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.263301 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_db.sqlalchemy.engines [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.267284 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_db.sqlalchemy.engines [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.421992 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_db.sqlalchemy.engines [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102802) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.425190 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG oslo_db.sqlalchemy.engines [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:27:52.758061 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: WARNING keystonemiddleware.auth_token [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:27:52.764360 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: WARNING keystonemiddleware.auth_token [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:27:52.768101 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: WARNING keystonemiddleware.auth_token [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:27:52.771773 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: WARNING keystonemiddleware.auth_token [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:27:53.110671 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: WARNING keystonemiddleware.auth_token [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:27:53.114578 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: WARNING keystonemiddleware.auth_token [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:27:53.116769 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: WARNING keystonemiddleware.auth_token [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:27:53.120718 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: WARNING keystonemiddleware.auth_token [None req-92452d4e-668f-4bab-8cbc-907f27557ccc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:27:53.122994 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55815a1979c0 pid: 102802 (default app) May 12 15:27:53.125108 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:27:53.126298 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] 10.222.0.89 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 May 12 15:27:53.126700 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 788 bytes} [Thu May 12 15:27:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:27:53.126852 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55815a1979c0 pid: 102801 (default app) May 12 15:29:10.940140 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:10.941242 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 12 15:29:10.941609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 2/2] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:11.374827 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-0b4a0771-57c0-460d-ba0e-e32ddbde1d2f admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:11.406313 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-0b4a0771-57c0-460d-ba0e-e32ddbde1d2f admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457695 May 12 15:29:11.407221 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 1/3] 10.222.0.89 () {60 vars in 1291 bytes} [Thu May 12 15:29:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:13.671373 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:13.672376 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-6870e7c1-907a-43b6-a4a7-228a93ef8741 None None] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001799 May 12 15:29:13.672800 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 3/4] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:13.730164 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-269838ee-524b-4839-9da1-6266c24ea967 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "ram": 256}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:13.748459 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:29:13.748459 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: warnings.warn(msg) May 12 15:29:13.778343 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-269838ee-524b-4839-9da1-6266c24ea967 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.099464 May 12 15:29:13.778882 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 2/5] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:13.996809 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-5f107eef-9004-456c-a182-384df5465cad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:13.999367 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:29:13.999367 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: warnings.warn(msg) May 12 15:29:14.047979 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-5f107eef-9004-456c-a182-384df5465cad admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260857 May 12 15:29:14.052590 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 4/6] 10.222.0.89 () {64 vars in 1335 bytes} [Thu May 12 15:29:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:16.299847 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-269838ee-524b-4839-9da1-6266c24ea967 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:16.301627 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-269838ee-524b-4839-9da1-6266c24ea967 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002272 May 12 15:29:16.302503 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 3/7] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:16.419137 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-d31bb180-d988-4641-85c5-892c8f84e02c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "disk": 5, "os-flavor-access:is_public": true}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:16.437168 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:29:16.437168 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: warnings.warn(msg) May 12 15:29:16.456027 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-d31bb180-d988-4641-85c5-892c8f84e02c admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147723 May 12 15:29:16.456584 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 5/8] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:16.468735 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-b5b0b5e6-04c9-4ba9-be05-c0a05a81be2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:16.470366 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:29:16.470366 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: warnings.warn(msg) May 12 15:29:16.504806 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-b5b0b5e6-04c9-4ba9-be05-c0a05a81be2f admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039968 May 12 15:29:16.505705 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 4/9] 10.222.0.89 () {64 vars in 1335 bytes} [Thu May 12 15:29:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:29:18.741709 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-d31bb180-d988-4641-85c5-892c8f84e02c admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:18.742735 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-d31bb180-d988-4641-85c5-892c8f84e02c admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 May 12 15:29:18.743176 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 6/10] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:18.803732 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-2a42c5c3-7de8-482a-b029-8ce2725e40b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:18.825166 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-2a42c5c3-7de8-482a-b029-8ce2725e40b2 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075742 May 12 15:29:18.832699 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 5/11] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:18.838362 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-4ae4d8c5-cd6e-4271-a615-04f193390dd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:18.863672 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-4ae4d8c5-cd6e-4271-a615-04f193390dd3 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029031 May 12 15:29:18.864690 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 7/12] 10.222.0.89 () {64 vars in 1335 bytes} [Thu May 12 15:29:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:29:21.135553 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-2a42c5c3-7de8-482a-b029-8ce2725e40b2 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:21.136727 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-2a42c5c3-7de8-482a-b029-8ce2725e40b2 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 May 12 15:29:21.137135 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 6/13] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:21.199565 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-a968429b-cf78-43c7-8977-ef8759c1d43e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:21.219233 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-a968429b-cf78-43c7-8977-ef8759c1d43e admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075607 May 12 15:29:21.219811 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 8/14] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:21.232043 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-2bb11ddc-ccf1-4d4c-a673-c7573cbfb4ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:21.257325 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-2bb11ddc-ccf1-4d4c-a673-c7573cbfb4ad admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029121 May 12 15:29:21.268501 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 7/15] 10.222.0.89 () {64 vars in 1335 bytes} [Thu May 12 15:29:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:23.530608 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-a968429b-cf78-43c7-8977-ef8759c1d43e admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:23.533106 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-a968429b-cf78-43c7-8977-ef8759c1d43e admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002900 May 12 15:29:23.533807 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 9/16] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:23.592047 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-ff5944fd-455e-4ed1-9485-7fd3b1f834cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:23.611442 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-ff5944fd-455e-4ed1-9485-7fd3b1f834cd admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071841 May 12 15:29:23.612630 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 8/17] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 15:29:23.623731 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-0eb26978-20c8-4971-b2f1-c87d78ce6bdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:23.646503 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-0eb26978-20c8-4971-b2f1-c87d78ce6bdc admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026471 May 12 15:29:23.648906 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 10/18] 10.222.0.89 () {64 vars in 1335 bytes} [Thu May 12 15:29:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:25.887394 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-ff5944fd-455e-4ed1-9485-7fd3b1f834cd admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:25.888406 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-ff5944fd-455e-4ed1-9485-7fd3b1f834cd admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 12 15:29:25.889010 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 9/19] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:25.951240 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-5437eca0-38fa-4cac-bb47-2c87844d3932 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:25.978401 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-5437eca0-38fa-4cac-bb47-2c87844d3932 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083185 May 12 15:29:25.979274 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 11/20] 10.222.0.89 () {60 vars in 1291 bytes} [Thu May 12 15:29:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:29:28.301418 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-ff5944fd-455e-4ed1-9485-7fd3b1f834cd admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:28.303007 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-ff5944fd-455e-4ed1-9485-7fd3b1f834cd admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 May 12 15:29:28.303566 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 10/21] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:29:28.368120 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-e4018903-0a46-460b-8890-5323bf19a1a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:28.386362 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-e4018903-0a46-460b-8890-5323bf19a1a9 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076547 May 12 15:29:28.387634 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 12/22] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:28.399653 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-25afc06c-9cc1-447a-9cab-99d9cb0bd471 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:28.423548 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-25afc06c-9cc1-447a-9cab-99d9cb0bd471 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027733 May 12 15:29:28.424141 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 11/23] 10.222.0.89 () {64 vars in 1332 bytes} [Thu May 12 15:29:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:30.684793 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-e4018903-0a46-460b-8890-5323bf19a1a9 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:30.685816 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-e4018903-0a46-460b-8890-5323bf19a1a9 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 May 12 15:29:30.686239 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 13/24] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:30.758091 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-e57db544-1016-4dea-898c-b2fc88358c7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "m1.small"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:30.777766 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-e57db544-1016-4dea-898c-b2fc88358c7c admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083917 May 12 15:29:30.778389 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 12/25] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:30.798262 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-41197805-f7b3-4ab9-9e04-00d5ae045231 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:30.840640 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-41197805-f7b3-4ab9-9e04-00d5ae045231 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049069 May 12 15:29:30.841261 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 14/26] 10.222.0.89 () {64 vars in 1332 bytes} [Thu May 12 15:29:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:29:33.307493 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-e57db544-1016-4dea-898c-b2fc88358c7c admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:33.309256 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-e57db544-1016-4dea-898c-b2fc88358c7c admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 May 12 15:29:33.309678 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 13/27] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:33.367924 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-cec16c8f-6c0b-41ec-88f9-f01b84a739a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:33.386816 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-cec16c8f-6c0b-41ec-88f9-f01b84a739a1 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071220 May 12 15:29:33.387396 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 15/28] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:33.399469 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-083f4e2a-6cd9-4c04-a501-1b279eb9353f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:33.423667 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-083f4e2a-6cd9-4c04-a501-1b279eb9353f admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027959 May 12 15:29:33.424462 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 14/29] 10.222.0.89 () {64 vars in 1332 bytes} [Thu May 12 15:29:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:35.649356 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-cec16c8f-6c0b-41ec-88f9-f01b84a739a1 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:35.650312 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-cec16c8f-6c0b-41ec-88f9-f01b84a739a1 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 12 15:29:35.650781 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 16/30] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:35.706993 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-39585d6a-130a-4648-85e4-597dc3925f55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:35.728264 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-39585d6a-130a-4648-85e4-597dc3925f55 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071691 May 12 15:29:35.729145 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 15/31] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 15:29:35.740826 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-0c70eb26-137d-48d9-96e2-ae9d8e574480 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:35.763936 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-0c70eb26-137d-48d9-96e2-ae9d8e574480 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026806 May 12 15:29:35.764823 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 17/32] 10.222.0.89 () {64 vars in 1332 bytes} [Thu May 12 15:29:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:29:38.123555 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-39585d6a-130a-4648-85e4-597dc3925f55 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:29:38.125263 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-39585d6a-130a-4648-85e4-597dc3925f55 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 May 12 15:29:38.125658 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 16/33] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:29:38.189879 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-5255ecd5-ebe3-4ba6-9d6a-eafea745a4bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5", "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:38.208515 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-5255ecd5-ebe3-4ba6-9d6a-eafea745a4bf admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076988 May 12 15:29:38.212937 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 18/34] 10.222.0.89 () {64 vars in 1282 bytes} [Thu May 12 15:29:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:29:38.223672 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-9c58ca47-44a0-443e-8965-d8a793ac80a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:29:38.248074 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-9c58ca47-44a0-443e-8965-d8a793ac80a0 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030681 May 12 15:29:38.249083 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 17/35] 10.222.0.89 () {64 vars in 1332 bytes} [Thu May 12 15:29:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:30:02.405495 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-5255ecd5-ebe3-4ba6-9d6a-eafea745a4bf admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:02.407114 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-5255ecd5-ebe3-4ba6-9d6a-eafea745a4bf admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002321 May 12 15:30:02.407783 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 19/36] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:30:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:02.472719 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-57eda505-9343-4acc-940e-fc897fa0fafa admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:02.495558 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-57eda505-9343-4acc-940e-fc897fa0fafa admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.081281 May 12 15:30:02.496088 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 18/37] 10.222.0.89 () {60 vars in 1291 bytes} [Thu May 12 15:30:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:03.513879 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-5255ecd5-ebe3-4ba6-9d6a-eafea745a4bf admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:03.514890 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-5255ecd5-ebe3-4ba6-9d6a-eafea745a4bf admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 12 15:30:03.515285 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 20/38] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:03.724146 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-e746df59-2265-4556-bca2-8495dd6a7889 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:03.730046 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.wsgi [None req-e746df59-2265-4556-bca2-8495dd6a7889 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-e746df59-2265-4556-bca2-8495dd6a7889 admin admin] Request method failure captured: May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Accept: application/json May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Accept-Encoding: gzip, deflate May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Connection: keep-alive May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Content-Length: 0 May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Host: 10.222.0.89 May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Openstack-Api-Version: compute 2.90 May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Openstack-System-Scope: None May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: User-Agent: python-novaclient May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Auth-Token: gAAAAABifSf7A70oCQynWIo9pB08WDX_feFQJnT9aGelTZdl9-U9v_VnZvEc19VYcP2CeuG7C11u1f8LDyuvBBpxXD-4burXhBydfaBJN6xuQYDwFjrwGugX3H_uV348Rk69hgkhdNXJSsrXsYKcGSLIenr8zjbRHjzks4Tii4i_HQ5DyotDHVU May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Domain-Id: None May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Domain-Name: None May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Identity-Status: Confirmed May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Is-Admin-Project: True May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Openstack-Nova-Api-Version: 2.90 May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Domain-Id: default May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Domain-Name: Default May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Name: admin May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Role: member,reader,admin May 12 15:30:03.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Roles: member,reader,admin May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7f10033f54fc4f68bcca36ed454874f3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant: admin May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant-Name: admin May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User: admin May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Domain-Id: default May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Domain-Name: Default May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Id: 756e113826714227aa38d8b173dcc786 May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Name: admin May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: method: > May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: exception: Flavor 42 could not be found. May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: action_args: {'id': '42'} May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:30:03.735118 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:03.737482 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:03.738890 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-e746df59-2265-4556-bca2-8495dd6a7889 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:30:03.740297 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-e746df59-2265-4556-bca2-8495dd6a7889 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.079404 May 12 15:30:03.740297 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 19/39] 10.222.0.89 () {60 vars in 1190 bytes} [Thu May 12 15:30:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 15:30:03.744898 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-9218dc06-05ef-450d-99cd-b0509ea02b1c admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:03.767013 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-9218dc06-05ef-450d-99cd-b0509ea02b1c admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025770 May 12 15:30:03.767546 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 21/40] 10.222.0.89 () {60 vars in 1210 bytes} [Thu May 12 15:30:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:03.778150 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-90401917-2223-4e2a-a966-392428861b36 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:03.799497 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-90401917-2223-4e2a-a966-392428861b36 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025045 May 12 15:30:03.800048 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 20/41] 10.222.0.89 () {60 vars in 1210 bytes} [Thu May 12 15:30:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:03.809264 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-dc049ac8-abe1-4e2c-9c1b-9a94bea7b21c admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:03.815478 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.wsgi [None req-dc049ac8-abe1-4e2c-9c1b-9a94bea7b21c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-dc049ac8-abe1-4e2c-9c1b-9a94bea7b21c admin admin] Request method failure captured: May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Accept: application/json May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Accept-Encoding: gzip, deflate May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Connection: keep-alive May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Content-Length: 0 May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Host: 10.222.0.89 May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Openstack-Api-Version: compute 2.90 May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Openstack-System-Scope: None May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: User-Agent: python-novaclient May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Auth-Token: gAAAAABifSf7A70oCQynWIo9pB08WDX_feFQJnT9aGelTZdl9-U9v_VnZvEc19VYcP2CeuG7C11u1f8LDyuvBBpxXD-4burXhBydfaBJN6xuQYDwFjrwGugX3H_uV348Rk69hgkhdNXJSsrXsYKcGSLIenr8zjbRHjzks4Tii4i_HQ5DyotDHVU May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Domain-Id: None May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Domain-Name: None May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Identity-Status: Confirmed May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Is-Admin-Project: True May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Openstack-Nova-Api-Version: 2.90 May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Domain-Id: default May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Domain-Name: Default May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Name: admin May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Role: member,reader,admin May 12 15:30:03.819126 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Roles: member,reader,admin May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7f10033f54fc4f68bcca36ed454874f3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant: admin May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant-Name: admin May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User: admin May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Domain-Id: default May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Domain-Name: Default May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Id: 756e113826714227aa38d8b173dcc786 May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Name: admin May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: method: > May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: exception: Flavor 42 could not be found. May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: action_args: {'id': '42'} May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:30:03.820755 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:03.821762 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:03.823093 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-dc049ac8-abe1-4e2c-9c1b-9a94bea7b21c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:30:03.824332 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-dc049ac8-abe1-4e2c-9c1b-9a94bea7b21c admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014833 May 12 15:30:03.824332 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 22/42] 10.222.0.89 () {60 vars in 1190 bytes} [Thu May 12 15:30:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 15:30:04.732181 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-90401917-2223-4e2a-a966-392428861b36 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:04.733270 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-90401917-2223-4e2a-a966-392428861b36 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 12 15:30:04.733688 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 21/43] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:04.930225 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-0698e768-71c1-4b8a-b566-b8d4a5b76c18 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:04.936003 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.wsgi [None req-0698e768-71c1-4b8a-b566-b8d4a5b76c18 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-0698e768-71c1-4b8a-b566-b8d4a5b76c18 admin admin] Request method failure captured: May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Accept: application/json May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Accept-Encoding: gzip, deflate May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Connection: keep-alive May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Content-Length: 0 May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Host: 10.222.0.89 May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Openstack-Api-Version: compute 2.90 May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Openstack-System-Scope: None May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: User-Agent: python-novaclient May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Auth-Token: gAAAAABifSf8ci2Ezya0UHH7GodxoH_FcCVSCwcXezy-E5VKWCtf5fpDgv-uq9mLWI6ZhiyOvhrCJS1Gx0QlnTccpIJTXArcc0gsCUQYq_8purkNVDuQ5hXPLXBUP3sLAdHfjpBRec1ukL-4AlCElOFEbM8hk7r9uFwlArl-qnC1XsCkDVKqivc May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Domain-Id: None May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Domain-Name: None May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Identity-Status: Confirmed May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Is-Admin-Project: True May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Openstack-Nova-Api-Version: 2.90 May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Domain-Id: default May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Domain-Name: Default May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Name: admin May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Role: member,reader,admin May 12 15:30:04.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Roles: member,reader,admin May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7f10033f54fc4f68bcca36ed454874f3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant: admin May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant-Name: admin May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User: admin May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Domain-Id: default May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Domain-Name: Default May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Id: 756e113826714227aa38d8b173dcc786 May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Name: admin May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: method: > May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: exception: Flavor 84 could not be found. May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: action_args: {'id': '84'} May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:30:04.939133 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:04.940118 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:04.941320 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-0698e768-71c1-4b8a-b566-b8d4a5b76c18 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:30:04.942448 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-0698e768-71c1-4b8a-b566-b8d4a5b76c18 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070067 May 12 15:30:04.942448 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 23/44] 10.222.0.89 () {60 vars in 1190 bytes} [Thu May 12 15:30:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 15:30:04.949332 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-6a4f2c24-364e-4e0b-9121-3ba1a6b042b5 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:04.963467 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-6a4f2c24-364e-4e0b-9121-3ba1a6b042b5 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017819 May 12 15:30:04.963993 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 22/45] 10.222.0.89 () {60 vars in 1210 bytes} [Thu May 12 15:30:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:04.973672 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-81c8ed4e-f9fa-4337-8c17-cbff54a05ab2 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:04.987286 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-81c8ed4e-f9fa-4337-8c17-cbff54a05ab2 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017138 May 12 15:30:04.987764 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 24/46] 10.222.0.89 () {60 vars in 1210 bytes} [Thu May 12 15:30:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:04.997020 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-d8776026-aabc-475b-96cd-6c1df8152b3b admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:05.002363 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.wsgi [None req-d8776026-aabc-475b-96cd-6c1df8152b3b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-d8776026-aabc-475b-96cd-6c1df8152b3b admin admin] Request method failure captured: May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Accept: application/json May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Accept-Encoding: gzip, deflate May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Connection: keep-alive May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Content-Length: 0 May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Host: 10.222.0.89 May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Openstack-Api-Version: compute 2.90 May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Openstack-System-Scope: None May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: User-Agent: python-novaclient May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Auth-Token: gAAAAABifSf8ci2Ezya0UHH7GodxoH_FcCVSCwcXezy-E5VKWCtf5fpDgv-uq9mLWI6ZhiyOvhrCJS1Gx0QlnTccpIJTXArcc0gsCUQYq_8purkNVDuQ5hXPLXBUP3sLAdHfjpBRec1ukL-4AlCElOFEbM8hk7r9uFwlArl-qnC1XsCkDVKqivc May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Domain-Id: None May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Domain-Name: None May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Identity-Status: Confirmed May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Is-Admin-Project: True May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Openstack-Nova-Api-Version: 2.90 May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Domain-Id: default May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Domain-Name: Default May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Name: admin May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Role: member,reader,admin May 12 15:30:05.003851 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Roles: member,reader,admin May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7f10033f54fc4f68bcca36ed454874f3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant: admin May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant-Name: admin May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User: admin May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Domain-Id: default May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Domain-Name: Default May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Id: 756e113826714227aa38d8b173dcc786 May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Name: admin May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: method: > May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: exception: Flavor 84 could not be found. May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: action_args: {'id': '84'} May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:30:05.005407 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:05.006307 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:05.007367 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-d8776026-aabc-475b-96cd-6c1df8152b3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:30:05.008448 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-d8776026-aabc-475b-96cd-6c1df8152b3b admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011735 May 12 15:30:05.008448 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 23/47] 10.222.0.89 () {60 vars in 1190 bytes} [Thu May 12 15:30:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 15:30:05.881406 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-81c8ed4e-f9fa-4337-8c17-cbff54a05ab2 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:05.882454 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-81c8ed4e-f9fa-4337-8c17-cbff54a05ab2 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 May 12 15:30:05.882828 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 25/48] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:06.072937 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-0cca1899-eeb2-4c99-a1ba-eb8e60f99e3d admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:06.079308 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.wsgi [None req-0cca1899-eeb2-4c99-a1ba-eb8e60f99e3d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-0cca1899-eeb2-4c99-a1ba-eb8e60f99e3d admin admin] Request method failure captured: May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Accept: application/json May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Accept-Encoding: gzip, deflate May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Connection: keep-alive May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Content-Length: 0 May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Host: 10.222.0.89 May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Openstack-Api-Version: compute 2.90 May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Openstack-System-Scope: None May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: User-Agent: python-novaclient May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Auth-Token: gAAAAABifSf9p0-wqCNGIaHOXcG4X6FDD7znZJZJ7nw9R9qwi_pV-Cq1TJJ4ZDX7Y_vx5MTC1qpWBkXfRfiOtgF7aJnTokd2VC9ojFUXcyqtdejBAZZB4x3OCKvrHg347iNCsB_Vx4bI9iV3Fab2315UhgJ85DeUre8gMtW_jj9kXnvSQ3GXJYY May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Domain-Id: None May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Domain-Name: None May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Identity-Status: Confirmed May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Is-Admin-Project: True May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Openstack-Nova-Api-Version: 2.90 May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Domain-Id: default May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Domain-Name: Default May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Project-Name: admin May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Role: member,reader,admin May 12 15:30:06.080848 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Roles: member,reader,admin May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7f10033f54fc4f68bcca36ed454874f3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant: admin May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-Tenant-Name: admin May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User: admin May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Domain-Id: default May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Domain-Name: Default May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Id: 756e113826714227aa38d8b173dcc786 May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: X-User-Name: admin May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: method: > May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: exception: Flavor 451 could not be found. May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: action_args: {'id': '451'} May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:30:06.082342 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:06.083194 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: ERROR nova.api.openstack.wsgi May 12 15:30:06.084356 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-0cca1899-eeb2-4c99-a1ba-eb8e60f99e3d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:30:06.085490 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-0cca1899-eeb2-4c99-a1ba-eb8e60f99e3d admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064005 May 12 15:30:06.085490 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 24/49] 10.222.0.89 () {60 vars in 1193 bytes} [Thu May 12 15:30:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 15:30:06.092465 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-c5145e43-a6a3-4d34-a7d6-db0d94525bf6 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:06.106177 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-c5145e43-a6a3-4d34-a7d6-db0d94525bf6 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017431 May 12 15:30:06.106704 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 26/50] 10.222.0.89 () {60 vars in 1210 bytes} [Thu May 12 15:30:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:06.116274 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:06.130604 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017989 May 12 15:30:06.131126 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 25/51] 10.222.0.89 () {60 vars in 1210 bytes} [Thu May 12 15:30:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:30:06.140318 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-603df426-cf6c-437a-ab2f-dbb0c72ba88b admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:06.145594 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.wsgi [None req-603df426-cf6c-437a-ab2f-dbb0c72ba88b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-603df426-cf6c-437a-ab2f-dbb0c72ba88b admin admin] Request method failure captured: May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Accept: application/json May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Accept-Encoding: gzip, deflate May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Connection: keep-alive May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Content-Length: 0 May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Host: 10.222.0.89 May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Openstack-Api-Version: compute 2.90 May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Openstack-System-Scope: None May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: User-Agent: python-novaclient May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Auth-Token: gAAAAABifSf9p0-wqCNGIaHOXcG4X6FDD7znZJZJ7nw9R9qwi_pV-Cq1TJJ4ZDX7Y_vx5MTC1qpWBkXfRfiOtgF7aJnTokd2VC9ojFUXcyqtdejBAZZB4x3OCKvrHg347iNCsB_Vx4bI9iV3Fab2315UhgJ85DeUre8gMtW_jj9kXnvSQ3GXJYY May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Domain-Id: None May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Domain-Name: None May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Identity-Status: Confirmed May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Is-Admin-Project: True May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Openstack-Nova-Api-Version: 2.90 May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Domain-Id: default May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Domain-Name: Default May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Project-Name: admin May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Role: member,reader,admin May 12 15:30:06.147203 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Roles: member,reader,admin May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7f10033f54fc4f68bcca36ed454874f3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7f10033f54fc4f68bcca36ed454874f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant: admin May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant-Id: 7f10033f54fc4f68bcca36ed454874f3 May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-Tenant-Name: admin May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User: admin May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Domain-Id: default May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Domain-Name: Default May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Id: 756e113826714227aa38d8b173dcc786 May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: X-User-Name: admin May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: method: > May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: exception: Flavor 451 could not be found. May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: action_args: {'id': '451'} May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:30:06.148777 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:06.149776 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: ERROR nova.api.openstack.wsgi May 12 15:30:06.151047 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-603df426-cf6c-437a-ab2f-dbb0c72ba88b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102802) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:30:06.152306 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-603df426-cf6c-437a-ab2f-dbb0c72ba88b admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011714 May 12 15:30:06.152306 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 27/52] 10.222.0.89 () {60 vars in 1193 bytes} [Thu May 12 15:30:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 15:30:07.046636 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:07.047641 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001793 May 12 15:30:07.048032 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 26/53] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:07.252580 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-56e82fd9-8bb3-4cad-b43c-9e166c471562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:30:07.273089 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-56e82fd9-8bb3-4cad-b43c-9e166c471562 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.089012 May 12 15:30:07.273632 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 28/54] 10.222.0.89 () {64 vars in 1235 bytes} [Thu May 12 15:30:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:30:08.163785 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:08.165415 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 May 12 15:30:08.165994 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 27/55] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:08.375844 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-cd1a1250-d535-41dd-9c06-57ceb6a828b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:30:08.395232 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-cd1a1250-d535-41dd-9c06-57ceb6a828b9 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082339 May 12 15:30:08.395748 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 29/56] 10.222.0.89 () {64 vars in 1235 bytes} [Thu May 12 15:30:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:30:09.303869 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:09.304903 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 12 15:30:09.305295 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 28/57] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:09.517141 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-efb72bef-40e0-4a0e-b007-c11332e4beda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:30:09.541014 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-efb72bef-40e0-4a0e-b007-c11332e4beda admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.102151 May 12 15:30:09.541742 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 30/58] 10.222.0.89 () {64 vars in 1235 bytes} [Thu May 12 15:30:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:30:10.445753 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:10.447298 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 May 12 15:30:10.447696 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 29/59] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:10.643650 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-123bfabb-4083-4c25-9d6f-9559e60cb017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:30:10.664657 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-123bfabb-4083-4c25-9d6f-9559e60cb017 admin admin] 10.222.0.89 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082240 May 12 15:30:10.665137 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 31/60] 10.222.0.89 () {64 vars in 1235 bytes} [Thu May 12 15:30:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:30:11.552260 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:11.553340 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 12 15:30:11.553733 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 30/61] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:30:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:30:11.740380 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-65bdb6dd-12cd-467e-a38c-af58e568ac45 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:30:11.759698 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-65bdb6dd-12cd-467e-a38c-af58e568ac45 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070961 May 12 15:30:11.760160 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 32/62] 10.222.0.89 () {60 vars in 1202 bytes} [Thu May 12 15:30:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:31:13.434886 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:31:13.436242 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-5e0fb4ff-41f7-4883-9df3-e6e424db0ad7 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 May 12 15:31:13.436732 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 31/63] 10.222.0.89 () {54 vars in 930 bytes} [Thu May 12 15:31:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:31:13.502585 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-fcedb273-ce2a-444a-b1e7-12ddff67fba5 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:31:13.522153 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-fcedb273-ce2a-444a-b1e7-12ddff67fba5 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078826 May 12 15:31:13.522619 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 33/64] 10.222.0.89 () {60 vars in 1291 bytes} [Thu May 12 15:31:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:31:13.545300 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-55f1d728-f869-4947-bbab-f985bc06cf4f admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:31:13.553904 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-55f1d728-f869-4947-bbab-f985bc06cf4f admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013246 May 12 15:31:13.554410 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 32/65] 10.222.0.89 () {60 vars in 1282 bytes} [Thu May 12 15:31:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:31:13.565717 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-cc878553-6a60-4991-aaad-282a18f22433 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:31:13.573500 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-cc878553-6a60-4991-aaad-282a18f22433 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011433 May 12 15:31:13.574028 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 34/66] 10.222.0.89 () {60 vars in 1285 bytes} [Thu May 12 15:31:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:31:13.585357 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:31:13.593330 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011669 May 12 15:31:13.593849 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 33/67] 10.222.0.89 () {60 vars in 1285 bytes} [Thu May 12 15:31:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:31:13.606716 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-34641dbb-cf48-42cf-b0d1-43fdf88fc20a admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:31:13.616917 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-34641dbb-cf48-42cf-b0d1-43fdf88fc20a admin admin] 10.222.0.89 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014965 May 12 15:31:13.617433 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 35/68] 10.222.0.89 () {60 vars in 1282 bytes} [Thu May 12 15:31:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:34:53.838045 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:34:53.839365 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 May 12 15:34:53.839924 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 34/69] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:34:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:34:54.119548 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-1eb6a544-e344-4142-96ba-95925cb1f16f admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:34:54.120759 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:34:54.120759 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: warnings.warn(msg) May 12 15:34:54.122095 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-1eb6a544-e344-4142-96ba-95925cb1f16f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:34:54.122570 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-1eb6a544-e344-4142-96ba-95925cb1f16f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:34:54.123342 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-1eb6a544-e344-4142-96ba-95925cb1f16f admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:34:54.123769 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-1eb6a544-e344-4142-96ba-95925cb1f16f admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:34:54.156788 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-1eb6a544-e344-4142-96ba-95925cb1f16f admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.163075 May 12 15:34:54.157371 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 36/70] 10.222.0.89 () {60 vars in 1193 bytes} [Thu May 12 15:34:53 2022] GET /compute/v2.1/os-services => generated 794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:34:55.060655 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:34:55.061798 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 12 15:34:55.062036 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 35/71] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:34:55.254304 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-636f08bc-905f-42a7-8fd5-01abce83ef5e admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:34:55.255485 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:34:55.255485 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: warnings.warn(msg) May 12 15:34:55.256719 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-636f08bc-905f-42a7-8fd5-01abce83ef5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:34:55.257155 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-636f08bc-905f-42a7-8fd5-01abce83ef5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:34:55.257946 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-636f08bc-905f-42a7-8fd5-01abce83ef5e admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:34:55.258370 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-636f08bc-905f-42a7-8fd5-01abce83ef5e admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:34:55.277394 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-636f08bc-905f-42a7-8fd5-01abce83ef5e admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079529 May 12 15:34:55.277941 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 37/72] 10.222.0.89 () {60 vars in 1193 bytes} [Thu May 12 15:34:55 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:35:06.622552 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:35:06.623557 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 12 15:35:06.623952 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 36/73] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:35:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:35:06.822646 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-bf62cd9a-4bec-4c8e-8cbd-00dd278a3f3d admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:35:06.823808 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:35:06.823808 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: warnings.warn(msg) May 12 15:35:06.825022 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-bf62cd9a-4bec-4c8e-8cbd-00dd278a3f3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:35:06.825457 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-bf62cd9a-4bec-4c8e-8cbd-00dd278a3f3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:35:06.826258 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-bf62cd9a-4bec-4c8e-8cbd-00dd278a3f3d admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:35:06.826700 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-bf62cd9a-4bec-4c8e-8cbd-00dd278a3f3d admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:35:06.851132 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-bf62cd9a-4bec-4c8e-8cbd-00dd278a3f3d admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085618 May 12 15:35:06.851683 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 38/74] 10.222.0.89 () {60 vars in 1193 bytes} [Thu May 12 15:35:06 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:35:07.742486 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: DEBUG nova.api.openstack.wsgi [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] Calling method '>' {{(pid=102801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:35:07.743531 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: INFO nova.api.openstack.requestlog [None req-29e43c62-66c5-4b6a-a5f9-db14d8452ef4 admin admin] 10.222.0.89 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 12 15:35:07.743953 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: [pid: 102801|app: 0|req: 37/75] 10.222.0.89 () {56 vars in 1074 bytes} [Thu May 12 15:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:35:07.949362 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG nova.api.openstack.wsgi [None req-59ef13bf-4858-475d-b8c6-cb5b7b233631 admin admin] Calling method '>' {{(pid=102802) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:35:07.950529 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:35:07.950529 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: warnings.warn(msg) May 12 15:35:07.951745 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-59ef13bf-4858-475d-b8c6-cb5b7b233631 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:35:07.952181 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-59ef13bf-4858-475d-b8c6-cb5b7b233631 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:35:07.952986 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-59ef13bf-4858-475d-b8c6-cb5b7b233631 admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:35:07.953409 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: DEBUG oslo_concurrency.lockutils [None req-59ef13bf-4858-475d-b8c6-cb5b7b233631 admin admin] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102802) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:35:07.975579 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: INFO nova.api.openstack.requestlog [None req-59ef13bf-4858-475d-b8c6-cb5b7b233631 admin admin] 10.222.0.89 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.090737 May 12 15:35:07.976128 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: [pid: 102802|app: 0|req: 39/76] 10.222.0.89 () {60 vars in 1193 bytes} [Thu May 12 15:35:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:36:05.116976 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: Thu May 12 15:36:05 2022 - graceful shutdown triggered... May 12 15:36:05.117066 dv-cinder-835881-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 15:36:05.118376 dv-cinder-835881-11-iscsi devstack@n-api.service[102801]: Gracefully killing worker 1 (pid: 102801)... May 12 15:36:05.118799 dv-cinder-835881-11-iscsi devstack@n-api.service[102802]: Gracefully killing worker 2 (pid: 102802)... May 12 15:36:06.119319 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: worker 1 buried after 1 seconds May 12 15:36:06.119319 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: worker 2 buried after 1 seconds May 12 15:36:06.119319 dv-cinder-835881-11-iscsi devstack@n-api.service[102800]: goodbye to uWSGI. May 12 15:36:06.121844 dv-cinder-835881-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 15:36:06.122751 dv-cinder-835881-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 15:36:06.126943 dv-cinder-835881-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 15:36:06.149543 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 15:36:06 2022] *** May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: nodename: dv-cinder-835881-11-iscsi May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: machine: x86_64 May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: clock source: unix May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: pcre jit disabled May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: detected number of CPU cores: 4 May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: current working directory: / May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: detected binary path: /usr/bin/uwsgi-core May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: your processes number limit is 47680 May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: your memory page size is 4096 bytes May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: detected max file descriptor number: 2048 May 12 15:36:06.168419 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: lock engine: pthread robust mutexes May 12 15:36:06.169464 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: thunder lock: enabled May 12 15:36:06.169464 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 15:36:06.169464 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 15:36:06.223174 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: Python main interpreter initialized at 0x55632fd669c0 May 12 15:36:06.223430 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: python threads support enabled May 12 15:36:06.223430 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: your server socket listen backlog is limited to 100 connections May 12 15:36:06.223430 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: your mercy for graceful operations on workers is 90 seconds May 12 15:36:06.223684 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: mapped 403077 bytes (393 KB) for 2 cores May 12 15:36:06.223684 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: *** Operational MODE: preforking *** May 12 15:36:06.223991 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: *** uWSGI is running in multiple interpreter mode *** May 12 15:36:06.223991 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: spawned uWSGI master process (pid: 123619) May 12 15:36:06.224182 dv-cinder-835881-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 15:36:06.225347 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: spawned uWSGI worker 1 (pid: 123632, cores: 1) May 12 15:36:06.225347 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: spawned uWSGI worker 2 (pid: 123633, cores: 1) May 12 15:36:06.225347 dv-cinder-835881-11-iscsi devstack@n-api.service[123619]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 15:36:07.420903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 15:36:07.421564 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 15:36:08.201254 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:36:08.201254 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: from cryptography.utils import int_from_bytes May 12 15:36:08.201628 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:36:08.201628 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: from cryptography.utils import int_from_bytes May 12 15:36:08.203789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:36:08.203789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: from cryptography.utils import int_from_bytes May 12 15:36:08.204107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 15:36:08.204107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: from cryptography.utils import int_from_bytes May 12 15:36:10.588422 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 15:36:10.589084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 15:36:10.589241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 15:36:10.589548 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 15:36:10.589779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 15:36:10.590164 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.590483 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.590802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.591118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.591431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.591718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.592053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.592378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.592706 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.592986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.593297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.593620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-11-iscsi {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.593945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.594242 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.594551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.594868 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.595168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.595490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.595793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.596279 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.597751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.597751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.597751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.598456 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.598456 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.598906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.598906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.599325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.599543 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.599756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.600146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-11-iscsi {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.600462 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.600812 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.601124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.601540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.601850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.602163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.602484 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.602805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.603112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.603460 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.603758 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.604092 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.604405 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.604771 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.605073 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.605396 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.605710 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.606019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.606310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.606565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.606881 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.607197 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.607518 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.607838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.608091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.608379 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.608713 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.609031 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.609337 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.609641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.609943 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.610239 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.610552 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.610872 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.611161 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.611327 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 15:36:10.611861 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.612024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 15:36:10.612173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.612339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 15:36:10.612533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.612533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.612842 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 15:36:10.613005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.613260 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 15:36:10.613437 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.613786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.613786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.614582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.614582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.614883 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615040 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615211 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615684 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.615975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.616127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.616273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.616431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.616617 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.616868 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617166 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617794 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-11-iscsi {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.617939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.618229 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.618385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.618546 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.618692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.618838 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.618990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.619135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.619323 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.619487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.619649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.619803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.619949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.620152 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.623630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.623630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.624030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.624837 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.625013 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.625176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.625392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.625546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.625693 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.625847 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.626004 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.626151 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.626307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.626484 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.626640 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.626786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.627039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.627210 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.627420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.627589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.627818 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.627971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.628117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.628274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.628274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.628687 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-11-iscsi {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.628883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.629041 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.629203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.629360 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.629548 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.629717 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.629865 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.630046 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.630207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.630207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.630493 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.630682 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.630832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.631018 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.631174 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.631328 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.631474 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.631660 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.631834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.632039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.632197 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.632353 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.632555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.632751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.632909 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.633098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.633256 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.633414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.633733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.633894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.634053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.634206 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.634376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.635005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.635005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.635346 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.635504 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.635686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.635920 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.636084 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.636084 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.636413 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.636413 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.636747 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.636936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.637228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.637408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.637561 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.637714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.637870 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638028 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638512 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638658 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.638823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.639132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.639315 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.639491 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.639647 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.639834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.639999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.640154 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.640154 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.640440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.640618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.640787 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.640990 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.641227 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.641386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.641569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.641731 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.641892 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.642052 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.642206 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.642360 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.642518 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.642672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.642828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.643644 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.643996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.644157 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.644305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.644460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.89 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.645803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.645969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.89 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.646118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.646265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.646431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.646588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.646750 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.646897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.647062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.647302 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.647453 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.647647 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.647825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.647825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.648153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.648153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.648434 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.648618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.648774 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.648921 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.649108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.649268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.649416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.649570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.649718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.649869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.650015 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.650161 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.650306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.650538 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.650688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.650843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.650988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.651147 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.651303 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.651450 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.651603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.651779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.651963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.652118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.652282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.652428 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.652595 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.652741 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.652898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.653055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.653219 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.653365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.653511 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.653656 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.653815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.654140 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.654429 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.654604 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.655040 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.655206 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.655352 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.655497 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.655652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.656028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.656221 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.656377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.656551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.656713 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.656859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.657013 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.657197 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.657436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.657588 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.657743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.657899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.658068 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.658228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.658383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.658536 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.658681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.658838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.658984 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.659139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.659293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.659439 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.659584 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.659729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.659888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.660091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.660257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.660404 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.660625 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.660772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.660926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.661080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.661241 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.661389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.661549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.661698 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.661851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.662004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.662174 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.662330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.662475 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.662628 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.662780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.662935 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.663094 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.663248 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.663409 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.663561 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.663706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.663905 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.664245 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.664410 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.664590 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.664737 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.664897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.665333 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.665488 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.665635 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.665790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.665956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.666282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.666444 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.666595 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.666747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.666904 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.667075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.667355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.667610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.667763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 15:36:10.667910 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.668055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.668209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.668365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.668579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.668742 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.668897 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.669063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.669211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.669373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.669524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670187 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670638 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670792 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.670946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.671093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.671249 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.671417 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.671576 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.671734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.671882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.672078 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.672290 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.672450 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.672631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.672787 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.672787 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.673063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.673216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.673412 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.673569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.673727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.673883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.674038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.674213 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.674521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.674678 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.674824 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.674969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.675469 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.675638 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.675794 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.675961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.676115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.676453 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.676671 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.676832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.676991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.677145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.677293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.677439 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.677603 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.677833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.678114 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.678286 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.678447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.678593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.678740 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.678899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.679054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.679200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.679354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.679508 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.679728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.679883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680625 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.680939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.681354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.681538 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.681707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.681864 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682016 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682164 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682317 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682632 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.682932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683085 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683386 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683532 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.683960 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.684113 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.684269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.684630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.684792 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.684946 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.685099 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.685253 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.685680 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.685841 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.685988 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.686141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.686286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.686623 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.686791 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.686940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.687096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.687250 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.687405 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.687551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.687705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.687935 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.688119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.688312 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.688463 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.688722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.688877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689470 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689773 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.689919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690374 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690536 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.690992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.691280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.691948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.692177 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.692347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.692521 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.692684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.692832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.692987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.693135 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.693281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.693434 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.693580 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.693728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.694053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.694203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.694356 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.694522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.694817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.694978 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.695135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.695294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.695294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.696058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.696216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.696399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.696843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.697016 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.697172 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.697319 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.697508 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.697669 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.697828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.698068 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.698227 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.698451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.698611 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.698777 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.698925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699381 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699537 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699537 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699824 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.699970 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.700122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.700277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.700433 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.700617 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.700765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.700918 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.701070 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.701231 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.701393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.701540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.701703 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.701859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702322 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702630 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702777 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.702923 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703538 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703838 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.703994 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.704187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.704341 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.704577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.704749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.705039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.705209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.705373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.705521 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.705928 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.706079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.706234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.706397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.706397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.706692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707026 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707189 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.707983 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.708221 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.708374 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.708551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.708710 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.708857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709597 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709755 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.709755 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.710895 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.711051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.711197 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.711350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.711495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.711740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.711897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.712044 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.712203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.712351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.712612 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.712772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.712927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.713073 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.713219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.713364 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.713525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.713717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.713717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.714034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.714180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.714332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.714492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.714638 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.714817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.715146 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.715303 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.715456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.715617 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.715790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.716230 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.716397 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.716564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.716734 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.716890 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.717246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.717398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.717543 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.717697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.719142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.719312 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.719471 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.719910 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.720069 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.720267 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.720418 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.720609 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.720780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.720936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.721097 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.721249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.721400 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.721559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.721724 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.721878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722504 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722671 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.722992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.723152 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.723311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.723607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.723782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.723945 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.724107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.724356 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.724555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.724728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.724881 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.725043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.725393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.725553 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.725715 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.725883 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.726343 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.726510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.726663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.726827 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.726987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.727168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.727543 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.727712 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.727873 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.728027 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.728186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.728352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.728610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.728789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.729039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.729327 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.729544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.729809 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.729974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.730128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.730278 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.730432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.730592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.730592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.730891 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.731043 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.731453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.731646 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.731824 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.731998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.732226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.732400 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.732592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.732761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.732915 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.733065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.733400 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.733567 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.733729 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.733897 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.733995 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734136 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734324 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734324 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734853 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.734941 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735324 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735563 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735886 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.735985 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.736075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.736243 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.736630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.736735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.736835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.736925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737013 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737114 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737409 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737671 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.737873 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738008 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738478 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738755 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738944 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.738944 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739138 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739226 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739320 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739671 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.739946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740140 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740230 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740479 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740788 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.740971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741239 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741341 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741439 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741623 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.741914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742472 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742660 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.742932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743105 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743562 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743662 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743753 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.743948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744037 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744226 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744400 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744759 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744759 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.744927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745013 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745410 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745497 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745676 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745837 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.745936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746032 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746224 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746664 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746764 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.746946 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747131 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747401 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747489 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747575 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.747924 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748012 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748099 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748380 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748380 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748609 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.748829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749186 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749647 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749729 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749891 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.749967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750178 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750259 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.750940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751138 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751507 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751605 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751700 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751795 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.751981 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752242 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752346 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752543 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752643 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752746 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.752834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753189 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753382 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753476 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753562 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.753929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754016 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754101 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754371 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754540 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754676 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754877 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.754973 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755145 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755238 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755325 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755420 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755687 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755820 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.755925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756288 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756529 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.756927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757369 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757462 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757545 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757620 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757775 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757851 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.757997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758077 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758165 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758247 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758323 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758776 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758776 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758906 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.758979 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759134 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759369 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759674 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759819 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.759972 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760126 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760287 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760457 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760910 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.760999 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761164 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761245 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761327 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.761969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762054 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762136 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762302 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762808 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.762987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763143 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763226 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763301 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763374 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763454 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763690 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763839 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.763911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764306 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764386 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764689 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.764929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765052 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765288 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765404 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765404 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765733 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765846 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.765967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766177 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766353 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766549 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766683 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.766929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767022 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767194 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767384 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767470 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.767796 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.768013 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.768117 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.768330 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.768436 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.768704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.768798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769123 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769427 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769732 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.769956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770359 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770576 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770678 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770884 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.770997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.771193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.771286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.771502 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.771610 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.771817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.771914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.772130 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.772224 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.772447 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.772604 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.772873 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.773043 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.773296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.773393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.773615 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.773722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.773931 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774359 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.774998 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.775205 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.775297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.775513 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.775614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.775823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.775917 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.776209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.776325 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.776515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.776650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.776958 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777056 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777162 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777262 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777562 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.777884 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.778096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.778204 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.778408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.778502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.778719 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.778821 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.779075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.779180 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.779388 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.779482 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.779691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.779802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.780986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.781107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.781296 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.781400 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.781610 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.781714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.781915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782016 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.782932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.783145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.783246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.783455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.783556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.783763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.783857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.784074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.784167 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.784388 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.784572 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.784722 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.784823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.785035 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.785135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.785349 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.785553 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.785677 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.785871 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786002 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786331 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786640 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.786992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.787182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.787286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.787496 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.787595 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.787804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.787919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.788110 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.788213 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.788412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.788527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.788756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.788866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789057 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789359 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789678 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.789984 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.790159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.790287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.790383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.790604 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.790697 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.790910 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.791004 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.791322 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.791426 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.791631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.791772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.791938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.792174 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.792304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.792530 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.792628 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.792862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.792976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.793179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.793282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.793485 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.793588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.793809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.793913 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.794115 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.794215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.794420 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.794514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.795100 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.795221 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.795403 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.795529 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.796210 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.796434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.796621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.796748 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.796862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.796984 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.797305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.797441 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.797558 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.797679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.797802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.797917 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798029 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798859 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.798973 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.799085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.799325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.799457 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.799723 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.799825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.799923 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800018 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800115 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800213 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800502 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800609 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.800969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801690 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.801979 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.802190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.802297 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.802518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.802611 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.802837 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.802939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.803142 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.803408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.803515 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.803748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.803858 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.804056 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.804170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.804375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.804502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.804708 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.804822 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805131 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805430 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.805975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.806191 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.806297 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.806526 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.806626 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.806845 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.806960 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.807173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.807287 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.807504 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.807612 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.807862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.807972 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.808170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.808276 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.808501 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.808597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.808819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.808926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.809134 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.809225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.809440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.809566 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.809748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.809881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810058 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810364 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.810984 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.811083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.811290 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.811399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.811603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.811705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.811908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812001 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812316 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812534 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812853 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.812967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.813168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.813341 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.813486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.813593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.813800 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.813898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.814114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.814222 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.814430 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.814524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.814738 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.814832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.815046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.815141 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.815357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.815459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.815665 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.815919 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.816022 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.816241 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.816343 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.816625 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.816742 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.816929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.817032 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.817280 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.817523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.817616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.817711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.817918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818060 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818250 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818647 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.818966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.819180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.819282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.819490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.819585 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.819795 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.819895 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.820103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.820204 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.820423 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.820549 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.820766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.820861 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.821095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.821198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.821408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.821516 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.821713 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.821948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.822041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.822307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.822429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.822620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.822721 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.822937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823243 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823888 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.823988 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.824200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.824295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.824514 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.824608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.824827 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.824938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.825129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.825234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.825430 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.825528 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.825733 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.825831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826196 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826337 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826427 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826739 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.826936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827235 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827526 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827615 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.827934 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.828124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.828227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.828429 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.828560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.828750 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.828862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829158 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.829966 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830274 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830376 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830591 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830699 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830895 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.830995 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.831206 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.831314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.831510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.831619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.831826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.831936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.832135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.832247 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.832455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.832618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.832764 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.832859 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.833093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.833208 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.833401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.833508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.833719 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.833832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834125 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834423 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834625 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.834930 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835251 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835571 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.835978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.836200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.836432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.836576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.836801 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.836916 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.837230 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.837433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.837526 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.837761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.837876 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.838067 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.838161 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.838374 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.838513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.838689 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.838803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839116 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839632 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839744 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.839945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.840052 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.840257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.840360 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.840598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.840696 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.840914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.841020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.841229 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.841336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.841544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.841654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.841857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842612 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.842992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.843172 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.843275 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.843465 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.843567 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.843646 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 15:36:10.843856 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.844135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.844456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.844799 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.845116 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.845429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.845746 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.846062 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.846383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.846716 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.847032 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.847341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.847767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.848083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.848407 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.848868 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.849066 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.849398 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.849717 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.850033 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.850358 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.850672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.851003 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.851344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.851679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.852015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.852324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.852673 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.852984 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.853299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.853622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.853942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.854253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.854607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.854924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.855233 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.855542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.855848 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.856155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.856494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.856797 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.857107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.857411 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.857718 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.858025 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.858327 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.858639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.858943 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.859266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.859555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.859862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.860164 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.860519 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.860860 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.861180 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.861518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.861918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.862253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.862569 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.862897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.863309 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.863552 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.863867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.864210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.864549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.864869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.865184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.865501 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.865815 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.866130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.866464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.866796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.867109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.867377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_db.sqlalchemy.engines [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:10.867503 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.867774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.868080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.868399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.868752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.869086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.869438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.869754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.870074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.870546 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.870752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.871045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.871347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.871678 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.872007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.872342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.872694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.873051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.873369 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.873721 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.874046 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.874367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.874686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.874994 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 15:36:10.875228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 15:36:10.898519 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_db.sqlalchemy.engines [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:10.931578 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.context [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f87d5b30-e042-4499-b98c-f99906a2836c(cell1) {{(pid=123632) load_cells /opt/stack/nova/nova/context.py:464}} May 12 15:36:10.936062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:36:10.937652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:36:10.938462 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:36:10.940371 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:36:10.952012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_db.sqlalchemy.engines [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:10.953953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_db.sqlalchemy.engines [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:10.964542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.context [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f87d5b30-e042-4499-b98c-f99906a2836c(cell1) {{(pid=123633) load_cells /opt/stack/nova/nova/context.py:464}} May 12 15:36:10.969049 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:36:10.970553 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:36:10.971407 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:36:10.973408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:36:10.984347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_db.sqlalchemy.engines [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:10.986670 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_db.sqlalchemy.engines [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:11.112547 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_db.sqlalchemy.engines [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:11.148149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_db.sqlalchemy.engines [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 15:36:11.432497 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: WARNING keystonemiddleware.auth_token [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:36:11.440020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: WARNING keystonemiddleware.auth_token [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:36:11.470268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: WARNING keystonemiddleware.auth_token [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:36:11.478250 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: WARNING keystonemiddleware.auth_token [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:36:11.788854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: WARNING keystonemiddleware.auth_token [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:36:11.795558 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: WARNING keystonemiddleware.auth_token [None req-1861c26a-6cce-413e-9644-aed697968ea3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:36:11.800924 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55632fd669c0 pid: 123632 (default app) May 12 15:36:11.825682 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: WARNING keystonemiddleware.auth_token [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 15:36:11.831907 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: WARNING keystonemiddleware.auth_token [None req-68895bb3-64ed-4f97-88d2-5411a7b2915a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 15:36:11.837309 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55632fd669c0 pid: 123633 (default app) May 12 15:36:54.293048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-06e979e5-296c-405f-a14c-ee505cc02779 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Action: 'create', calling method: .version_select at 0x7f60d2e32280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1189652557", "metadata": {"Type": "work"}}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-06e979e5-296c-405f-a14c-ee505cc02779 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Request method failure captured: May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 122 May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmVB7c9yUCEd3b69UGkqN5lf6LgwfLxbWBiIw_GkYiLvh7sEGQbkXoIyqfNMiReJF4l0mlZJDf9xXvC9LIkcbhzbSAKGxOl8mV3P1MO6D9QzOFlxcuy_gC6F3-4wypqKRaF1OHuSgRsy2fGwmrWyzmcH4_8f2Ej6IHVWSVizER50Qs May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:36:54.317500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_830115e9b8a24060816f2e973a3a5ca4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesNegativeTest-726834014-project May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 2c3da2b4f3da4d3586d2144721a04780 May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesNegativeTest-726834014-project May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1189652557", "metadata": {"Type": "work"}}} May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:36:54.318974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1189652557', 'metadata': {'Type': 'work'}}}} May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise error May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi '#$%' May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:54.319825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 15:36:54.321842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 15:36:54.324051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 15:36:54.324051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.324051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-06e979e5-296c-405f-a14c-ee505cc02779 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:54.324051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-06e979e5-296c-405f-a14c-ee505cc02779 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.230290 May 12 15:36:54.324051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 1/1] 10.222.0.89 () {60 vars in 1155 bytes} [Thu May 12 15:36:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 15:36:54.343240 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-13dc4268-a746-4356-9981-3fe33b962138 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Action: 'create', calling method: .version_select at 0x7f60d2cd55e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-564653815", "metadata": {"Type": "work"}}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-13dc4268-a746-4356-9981-3fe33b962138 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Request method failure captured: May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 119 May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmVB7c9yUCEd3b69UGkqN5lf6LgwfLxbWBiIw_GkYiLvh7sEGQbkXoIyqfNMiReJF4l0mlZJDf9xXvC9LIkcbhzbSAKGxOl8mV3P1MO6D9QzOFlxcuy_gC6F3-4wypqKRaF1OHuSgRsy2fGwmrWyzmcH4_8f2Ej6IHVWSVizER50Qs May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:36:54.355658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_830115e9b8a24060816f2e973a3a5ca4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesNegativeTest-726834014-project May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 2c3da2b4f3da4d3586d2144721a04780 May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesNegativeTest-726834014-project May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-564653815", "metadata": {"Type": "work"}}} May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:36:54.357299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-564653815', 'metadata': {'Type': 'work'}}}} May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise error May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi '0' May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:54.358141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 15:36:54.359524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 15:36:54.360683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 15:36:54.360683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.360683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-13dc4268-a746-4356-9981-3fe33b962138 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:54.360683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-13dc4268-a746-4356-9981-3fe33b962138 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019923 May 12 15:36:54.361243 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 2/2] 10.222.0.89 () {60 vars in 1155 bytes} [Thu May 12 15:36:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 12 15:36:54.381767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a6a308dd-2215-454d-86de-7737b3709f96 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Action: 'create', calling method: .version_select at 0x7f60d2e325e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-316072239", "metadata": {"Type": "work"}}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a6a308dd-2215-454d-86de-7737b3709f96 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Request method failure captured: May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 118 May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmVB7c9yUCEd3b69UGkqN5lf6LgwfLxbWBiIw_GkYiLvh7sEGQbkXoIyqfNMiReJF4l0mlZJDf9xXvC9LIkcbhzbSAKGxOl8mV3P1MO6D9QzOFlxcuy_gC6F3-4wypqKRaF1OHuSgRsy2fGwmrWyzmcH4_8f2Ej6IHVWSVizER50Qs May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:36:54.385968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_830115e9b8a24060816f2e973a3a5ca4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesNegativeTest-726834014-project May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 2c3da2b4f3da4d3586d2144721a04780 May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesNegativeTest-726834014-project May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-316072239", "metadata": {"Type": "work"}}} May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:36:54.387630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-316072239', 'metadata': {'Type': 'work'}}}} May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise error May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi '' May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:54.388620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 15:36:54.390717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 15:36:54.392059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 15:36:54.392059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:54.400183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a6a308dd-2215-454d-86de-7737b3709f96 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:54.402246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a6a308dd-2215-454d-86de-7737b3709f96 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.032180 May 12 15:36:54.406077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 3/3] 10.222.0.89 () {60 vars in 1155 bytes} [Thu May 12 15:36:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 15:36:54.426314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-150abd4b-30ba-4012-a1c1-4888e45bdfcd tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Calling method '.version_select at 0x7f60d2ce4310>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:54.850311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e8fe4576-308b-4533-838b-9d0cc7df7b53 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Action: 'create', calling method: .version_select at 0x7f60d2e31280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1437420310", "metadata": {"Type": "work"}}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:36:55.537356 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-150abd4b-30ba-4012-a1c1-4888e45bdfcd tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] HTTP exception thrown: Volume tempest-invalid-2053946229 could not be found. May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-150abd4b-30ba-4012-a1c1-4888e45bdfcd tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Request method failure captured: May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2053946229 HTTP/1.1 May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmVB7c9yUCEd3b69UGkqN5lf6LgwfLxbWBiIw_GkYiLvh7sEGQbkXoIyqfNMiReJF4l0mlZJDf9xXvC9LIkcbhzbSAKGxOl8mV3P1MO6D9QzOFlxcuy_gC6F3-4wypqKRaF1OHuSgRsy2fGwmrWyzmcH4_8f2Ej6IHVWSVizER50Qs May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:36:55.542503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_830115e9b8a24060816f2e973a3a5ca4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesNegativeTest-726834014-project May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 2c3da2b4f3da4d3586d2144721a04780 May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesNegativeTest-726834014-project May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Volume tempest-invalid-2053946229 could not be found. May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'tempest-invalid-2053946229'} May 12 15:36:55.543913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2053946229 could not be found. (HTTP 404) (Request-ID: req-91a63b7c-8fb0-4dc1-b25e-11ef871e0ec3) May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.545160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 15:36:55.546712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2053946229 could not be found. May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:36:55.548806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2053946229 could not be found. May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2053946229 could not be found. May 12 15:36:55.551179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.559017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-150abd4b-30ba-4012-a1c1-4888e45bdfcd tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Returning 404 to user: Volume tempest-invalid-2053946229 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:55.561368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-150abd4b-30ba-4012-a1c1-4888e45bdfcd tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2053946229" status: 404 len: 99 microversion: 2.1 time: 1.149253 May 12 15:36:55.563283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 4/4] 10.222.0.89 () {58 vars in 1217 bytes} [Thu May 12 15:36:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2053946229 => generated 99 bytes in 1152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 15:36:55.586236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ecef490e-3af8-4439-91d6-57c034ed4d5d tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016605 May 12 15:36:55.593776 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 5/5] 10.222.0.89 () {58 vars in 1139 bytes} [Thu May 12 15:36:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 15:36:55.602235 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fe9b53de-2bf8-40f1-9750-8d8da97ae27d tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007125 May 12 15:36:55.610351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 6/6] 10.222.0.89 () {58 vars in 1136 bytes} [Thu May 12 15:36:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 15:36:55.625585 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-570caa78-ef4e-4a6a-ba66-68317a072961 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Calling method '.version_select at 0x7f60d2c0e160>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:55.870211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-570caa78-ef4e-4a6a-ba66-68317a072961 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] HTTP exception thrown: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-570caa78-ef4e-4a6a-ba66-68317a072961 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Request method failure captured: May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/os-volumes/364e4645-ac5e-424d-ab8f-4af3da3b3970 HTTP/1.1 May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmVB7c9yUCEd3b69UGkqN5lf6LgwfLxbWBiIw_GkYiLvh7sEGQbkXoIyqfNMiReJF4l0mlZJDf9xXvC9LIkcbhzbSAKGxOl8mV3P1MO6D9QzOFlxcuy_gC6F3-4wypqKRaF1OHuSgRsy2fGwmrWyzmcH4_8f2Ej6IHVWSVizER50Qs May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:36:55.872580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_830115e9b8a24060816f2e973a3a5ca4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesNegativeTest-726834014-project May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 2c3da2b4f3da4d3586d2144721a04780 May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesNegativeTest-726834014-project May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '364e4645-ac5e-424d-ab8f-4af3da3b3970'} May 12 15:36:55.873915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. (HTTP 404) (Request-ID: req-db04565d-acb8-49e4-9eea-68f11a348ddb) May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.874707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 15:36:55.876074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 15:36:55.877212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-570caa78-ef4e-4a6a-ba66-68317a072961 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Returning 404 to user: Volume 364e4645-ac5e-424d-ab8f-4af3da3b3970 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-570caa78-ef4e-4a6a-ba66-68317a072961 tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/364e4645-ac5e-424d-ab8f-4af3da3b3970" status: 404 len: 109 microversion: 2.1 time: 0.262535 May 12 15:36:55.879541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 7/7] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:36:55 2022] DELETE /compute/v2.1/os-volumes/364e4645-ac5e-424d-ab8f-4af3da3b3970 => generated 109 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:36:55.887860 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d926d928-72d2-4fde-8151-24a55cf3139f tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Calling method '.version_select at 0x7f60d2c0e280>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:55.964615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-d926d928-72d2-4fde-8151-24a55cf3139f tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] HTTP exception thrown: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d926d928-72d2-4fde-8151-24a55cf3139f tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Request method failure captured: May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/os-volumes/df6e1fc7-595e-469d-9f7d-c455b41c6968 HTTP/1.1 May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmVB7c9yUCEd3b69UGkqN5lf6LgwfLxbWBiIw_GkYiLvh7sEGQbkXoIyqfNMiReJF4l0mlZJDf9xXvC9LIkcbhzbSAKGxOl8mV3P1MO6D9QzOFlxcuy_gC6F3-4wypqKRaF1OHuSgRsy2fGwmrWyzmcH4_8f2Ej6IHVWSVizER50Qs May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:36:55.966532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_830115e9b8a24060816f2e973a3a5ca4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/830115e9b8a24060816f2e973a3a5ca4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 830115e9b8a24060816f2e973a3a5ca4 May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesNegativeTest-726834014 May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesNegativeTest-726834014-project May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 2c3da2b4f3da4d3586d2144721a04780 May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesNegativeTest-726834014-project May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'df6e1fc7-595e-469d-9f7d-c455b41c6968'} May 12 15:36:55.968089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. (HTTP 404) (Request-ID: req-c2145477-cc9e-4a15-9f95-eb719f05011d) May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.969068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:36:55.971199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 15:36:55.973322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d926d928-72d2-4fde-8151-24a55cf3139f tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] Returning 404 to user: Volume df6e1fc7-595e-469d-9f7d-c455b41c6968 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:55.975564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d926d928-72d2-4fde-8151-24a55cf3139f tempest-VolumesNegativeTest-726834014 tempest-VolumesNegativeTest-726834014-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/df6e1fc7-595e-469d-9f7d-c455b41c6968" status: 404 len: 109 microversion: 2.1 time: 0.088026 May 12 15:36:55.978581 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 8/8] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:55 2022] GET /compute/v2.1/os-volumes/df6e1fc7-595e-469d-9f7d-c455b41c6968 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:36:56.521449 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e8fe4576-308b-4533-838b-9d0cc7df7b53 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.060874 May 12 15:36:56.522417 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 1/9] 10.222.0.89 () {60 vars in 1155 bytes} [Thu May 12 15:36:53 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3065 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 15:36:56.537084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-115ad48e-e206-4c72-a514-85116a2d4e96 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Calling method '.version_select at 0x7f60d2c70af0>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:56.683732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-115ad48e-e206-4c72-a514-85116a2d4e96 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9" status: 200 len: 353 microversion: 2.1 time: 0.151579 May 12 15:36:56.684621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 9/10] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:56 2022] GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:36:56.846014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d65e205d-5ce3-40c9-86bf-567688d8d795 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2c86280>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:56.969976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d65e205d-5ce3-40c9-86bf-567688d8d795 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/42518b78-c7c8-4275-a665-51879aa8b2a6" status: 200 len: 349 microversion: 2.1 time: 0.139764 May 12 15:36:56.970742 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 2/11] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:56 2022] GET /compute/v2.1/os-volumes/42518b78-c7c8-4275-a665-51879aa8b2a6 => generated 349 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:36:57.452897 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-248104843", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "networks": [{"uuid": "7ef2da11-6583-4235-854e-6839ff8d5196"}]}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:36:57.698275 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-77721c49-7c54-4bef-b469-865f8afedc93 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Calling method '.version_select at 0x7f60d2c86310>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:57.736754 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] validate_networks() for [('7ef2da11-6583-4235-854e-6839ff8d5196', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:36:57.929264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-77721c49-7c54-4bef-b469-865f8afedc93 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9" status: 200 len: 354 microversion: 2.1 time: 0.231954 May 12 15:36:57.931333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 3/12] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:57 2022] GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 => generated 354 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:36:57.954267 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6a3c6f70-8f58-415c-be5b-6af8adc30109 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Calling method '.version_select at 0x7f60d2c86a60>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:58.082258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6a3c6f70-8f58-415c-be5b-6af8adc30109 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9" status: 200 len: 354 microversion: 2.1 time: 0.135596 May 12 15:36:58.089209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 4/13] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:57 2022] GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:36:58.118113 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0ba91ada-325a-493b-84cc-8efed3e1a542 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Calling method '.version_select at 0x7f60d2c92160>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:58.262411 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0ba91ada-325a-493b-84cc-8efed3e1a542 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9" status: 202 len: 0 microversion: 2.1 time: 0.157158 May 12 15:36:58.262877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 5/14] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:36:58 2022] DELETE /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:36:58.270970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f43353b0-2964-4c5c-b568-863df0e4e8f0 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Calling method '.version_select at 0x7f60d2c86b80>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:58.357303 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f43353b0-2964-4c5c-b568-863df0e4e8f0 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9" status: 200 len: 353 microversion: 2.1 time: 0.090232 May 12 15:36:58.357874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 6/15] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:58 2022] GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:36:58.948572 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3e95456e-1f94-492b-9850-7f7a91180ed1 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2c86160>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:59.067707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3e95456e-1f94-492b-9850-7f7a91180ed1 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/6c3bf4db-8e6c-450a-8a66-a9ee5ef3bd18" status: 200 len: 350 microversion: 2.1 time: 0.123607 May 12 15:36:59.074542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 7/16] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:58 2022] GET /compute/v2.1/os-volumes/6c3bf4db-8e6c-450a-8a66-a9ee5ef3bd18 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:36:59.370619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9a368785-c3c9-4844-86e6-256c642ac025 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Calling method '.version_select at 0x7f60d2c92700>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:36:59.772735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-9a368785-c3c9-4844-86e6-256c642ac025 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] HTTP exception thrown: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9a368785-c3c9-4844-86e6-256c642ac025 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Request method failure captured: May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 HTTP/1.1 May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSmVOAq5FbdcWEjok5TP1wfTHR4uWHLN-B1xRmru-8YTb_9bGV7UU6nr7POx1IfDXGAUIQkuMB0Ha638t3x9zrvRrHHf_UzFV7h0_895wRMeia8h8IAATsIvFwzCR-dJ7UdfCBbbH39LTenpCjxmB7ZlXIx5MQgX4A-DYNHuqcOSsrA May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 4f25b8cf2e9e4bc49df36ff4b00e5f68 May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-VolumesGetTestJSON-1084578779 May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:36:59.777284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_4f25b8cf2e9e4bc49df36ff4b00e5f68", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/4f25b8cf2e9e4bc49df36ff4b00e5f68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4f25b8cf2e9e4bc49df36ff4b00e5f68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4f25b8cf2e9e4bc49df36ff4b00e5f68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-VolumesGetTestJSON-1084578779 May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 4f25b8cf2e9e4bc49df36ff4b00e5f68 May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-VolumesGetTestJSON-1084578779 May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-VolumesGetTestJSON-1084578779-project May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: 49368c2c64a24e55ba993fa31dbfcb97 May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-VolumesGetTestJSON-1084578779-project May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'b9ffdca8-9f62-46b8-a790-d7f5905d35c9'} May 12 15:36:59.778498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. (HTTP 404) (Request-ID: req-4ebca6a2-d68b-4c1f-907b-5666dd754a3b) May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:59.779121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:36:59.783867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 15:36:59.785226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9a368785-c3c9-4844-86e6-256c642ac025 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] Returning 404 to user: Volume b9ffdca8-9f62-46b8-a790-d7f5905d35c9 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9a368785-c3c9-4844-86e6-256c642ac025 tempest-VolumesGetTestJSON-1084578779 tempest-VolumesGetTestJSON-1084578779-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9" status: 404 len: 109 microversion: 2.1 time: 0.412808 May 12 15:36:59.786464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 8/17] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:36:59 2022] GET /compute/v2.1/os-volumes/b9ffdca8-9f62-46b8-a790-d7f5905d35c9 => generated 109 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:37:00.217675 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:37:00.218337 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:37:00.218807 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:37:00.219206 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:37:00.219605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:37:00.262152 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:00.262622 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:00.263466 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:00.263892 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:00.362110 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Getting quotas for project dc278e450c714353be7f27fa08069574. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:37:00.381253 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Getting quotas for user ae507741bc8648d382b906009d6f0392 and project dc278e450c714353be7f27fa08069574. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:37:00.420200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:37:00.432936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:37:00.600139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9fbd82ba-6501-4eec-8e88-bb69f7f5ea7f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.357185 May 12 15:37:00.604513 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 10/18] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:37:00.611557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d9cfa671-8287-43e6-8afd-5e8d3ae42407 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:00.612918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d9cfa671-8287-43e6-8afd-5e8d3ae42407 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:00.851436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d9cfa671-8287-43e6-8afd-5e8d3ae42407 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:00.877047 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d9cfa671-8287-43e6-8afd-5e8d3ae42407 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1214 microversion: 2.1 time: 0.269508 May 12 15:37:00.891212 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 9/19] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:00 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:01.895955 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6d026927-6396-4921-9865-90882f1eb967 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:01.896670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6d026927-6396-4921-9865-90882f1eb967 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:02.599269 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6d026927-6396-4921-9865-90882f1eb967 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:02.628896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6d026927-6396-4921-9865-90882f1eb967 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1214 microversion: 2.1 time: 0.735937 May 12 15:37:02.630012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 11/20] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:01 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1214 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:03.647466 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:03.648029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:03.666910 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:03.672538 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:03.676672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:03.677295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:04.038911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:04.055881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f4abacaf-963f-4a75-b96a-400274f67f0b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1210 microversion: 2.1 time: 0.412894 May 12 15:37:04.071258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 10/21] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:03 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1210 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:04.473520 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-243dbadc-e10e-4941-a327-302ebadc9271 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2bb2c10>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:04.673243 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-243dbadc-e10e-4941-a327-302ebadc9271 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/f34c9f29-6f8d-4fd9-9ee4-2391b655e99d" status: 200 len: 350 microversion: 2.1 time: 0.203672 May 12 15:37:04.674535 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 11/22] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:37:04 2022] GET /compute/v2.1/os-volumes/f34c9f29-6f8d-4fd9-9ee4-2391b655e99d => generated 350 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:37:04.689077 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0f7e7f54-ab10-4e4d-b3e9-3a660ad56732 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2bbc310>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:04.894987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3c99c1b2-63de-4628-88a7-a33d1d9ad33b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: .version_select at 0x7f60d2317550>, body: {"keypair": {"name": "tempest-keypair-2147351746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlLXNTc0oliIYVjbooXG+crnZRaCcLbSTgux4DQ48eZzDcLzizIgdc26lCGUZBlbkgCVuF86LfBHfTZaBgyYpAJEwX2iiq7CWcKAPB35WwKlr4XV9zR/jtLFyg0ZE4FFA=="}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:04.898990 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0f7e7f54-ab10-4e4d-b3e9-3a660ad56732 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.215737 May 12 15:37:04.899713 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 12/23] 10.222.0.89 () {58 vars in 1133 bytes} [Thu May 12 15:37:04 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:04.948322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-3c99c1b2-63de-4628-88a7-a33d1d9ad33b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for project 8aba4b044dfa42cd8da55086ab774561. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:37:04.958713 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-3c99c1b2-63de-4628-88a7-a33d1d9ad33b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for user 99d68f67eb8949e0b0878527f86ee683 and project 8aba4b044dfa42cd8da55086ab774561. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:37:05.076383 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3c99c1b2-63de-4628-88a7-a33d1d9ad33b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.828525 May 12 15:37:05.078034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 12/24] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:37:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:05.097773 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-59c4be68-619d-4783-b5f5-8b5155a51e25 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d1ac8700>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:05.345399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-59c4be68-619d-4783-b5f5-8b5155a51e25 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.265856 May 12 15:37:05.346122 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 13/25] 10.222.0.89 () {58 vars in 1148 bytes} [Thu May 12 15:37:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:05.352171 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:05.357696 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:05.385878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:05.396044 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:05.398801 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:05.399482 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:05.456263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7c67d9ea-3593-43bd-b79a-f0f428eeb9dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'create', calling method: .version_select at 0x7f60d2bb2f70>, body: {"keypair": {"name": "tempest-keypair-785619572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWYfy453rtAUHF5I9Nin3+hYQl7D7TTh8dzIULLOeleE2H/WnPY8Fx0vosjIZ1P28famGJdpRvtt5nAgumFVTOrKoaHWvwKxNi1+w30G1ibyvkldAiIigm56lYX7BDFsA=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:05.636388 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-7c67d9ea-3593-43bd-b79a-f0f428eeb9dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:37:05.661573 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-7c67d9ea-3593-43bd-b79a-f0f428eeb9dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for user ee73f971f9844c85bd9b29749554dc37 and project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:37:05.853333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7c67d9ea-3593-43bd-b79a-f0f428eeb9dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.951741 May 12 15:37:05.860309 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 13/26] 10.222.0.89 () {62 vars in 1199 bytes} [Thu May 12 15:37:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 955 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 15:37:05.877848 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9e426a91-a948-4adf-9159-9efb7a8f8552 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2bb2670>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:06.163952 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9e426a91-a948-4adf-9159-9efb7a8f8552 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.301594 May 12 15:37:06.164564 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 14/27] 10.222.0.89 () {58 vars in 1133 bytes} [Thu May 12 15:37:05 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:06.177554 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1a4de844-eac5-49b5-871f-f98704a315de tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2afa160>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:06.434014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1a4de844-eac5-49b5-871f-f98704a315de tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.261316 May 12 15:37:06.435481 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 15/28] 10.222.0.89 () {58 vars in 1166 bytes} [Thu May 12 15:37:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:06.446474 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-43177637-241b-45a1-b7d2-d12e366e0b51 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2afadc0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:06.660252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:06.693556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f5cf0778-c88d-4f44-b8ac-e248c4614899 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1272 microversion: 2.1 time: 1.346303 May 12 15:37:06.704976 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 14/29] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:05 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1272 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:06.711538 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-43177637-241b-45a1-b7d2-d12e366e0b51 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.269386 May 12 15:37:06.712850 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 16/30] 10.222.0.89 () {58 vars in 1169 bytes} [Thu May 12 15:37:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:06.726704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-182faff1-7263-4526-96e0-c21376a8fce1 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d120f280>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:07.034631 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-182faff1-7263-4526-96e0-c21376a8fce1 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.313765 May 12 15:37:07.035220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 15/31] 10.222.0.89 () {58 vars in 1154 bytes} [Thu May 12 15:37:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:07.047613 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f7abe730-066b-4825-8096-0fec457df123 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d2afaa60>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:07.247246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f7abe730-066b-4825-8096-0fec457df123 tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.204267 May 12 15:37:07.248271 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 17/32] 10.222.0.89 () {58 vars in 1187 bytes} [Thu May 12 15:37:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:07.261984 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5923d391-c64f-44b1-926d-0a861ddb34aa tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] Calling method '.version_select at 0x7f60d1220b80>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:07.455810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5923d391-c64f-44b1-926d-0a861ddb34aa tempest-VolumesTestJSON-406750230 tempest-VolumesTestJSON-406750230-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.199615 May 12 15:37:07.471011 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 16/33] 10.222.0.89 () {58 vars in 1154 bytes} [Thu May 12 15:37:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:07.718547 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:07.729627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:07.752376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:07.758964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:07.758964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:07.758964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:09.585684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:09.595023 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-65b9748d-7f0d-4fe0-b406-2174944b9a94 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 1.882643 May 12 15:37:09.600117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 18/34] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:07 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:10.618498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:10.619886 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:10.642039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:10.643120 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:10.644392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:10.645167 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:10.740701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1988032991", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0a8c52-c0ac-43a2-8769-296b117079bb"}], "security_groups": [{"name": "tempest-securitygroup--165720697"}], "key_name": "tempest-keypair-785619572", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:11.548440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:11.561855 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f73fa4f9-e819-4d30-b915-62afdf414d23 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.947579 May 12 15:37:11.566819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 17/35] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:10 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:12.486700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] validate_networks() for [('8d0a8c52-c0ac-43a2-8769-296b117079bb', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:37:12.582225 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:12.584318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:12.597987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:12.599280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:12.602588 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:12.609619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:13.731944 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:13.746569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-40e8b947-a650-49d1-9845-4953c6501f67 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 1.171613 May 12 15:37:13.752996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 18/36] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:12 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:14.770487 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:14.771915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:14.791718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:14.797293 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:14.798701 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:14.799158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:15.573117 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:15.582723 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-37c24d33-2e72-4298-a209-bccd5eae52bd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.816695 May 12 15:37:15.595969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 19/37] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:14 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:16.024392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-6b7e6ea3-ab44-41db-a901-28da56e3d0cb req-20d1bfde-ce9e-4472-bc2f-bc77b00e76c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7e88b1-4973-431a-adfb-49a2d837ca0c", "tag": "c2c5418a-5981-4611-a818-0337a7b7c9d6"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:16.047035 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-6b7e6ea3-ab44-41db-a901-28da56e3d0cb req-20d1bfde-ce9e-4472-bc2f-bc77b00e76c4 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.048112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-6b7e6ea3-ab44-41db-a901-28da56e3d0cb req-20d1bfde-ce9e-4472-bc2f-bc77b00e76c4 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.091923 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-6b7e6ea3-ab44-41db-a901-28da56e3d0cb req-20d1bfde-ce9e-4472-bc2f-bc77b00e76c4 service nova] Creating event network-changed:c2c5418a-5981-4611-a818-0337a7b7c9d6 for instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c on hv-cinder-83588 May 12 15:37:16.093593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-6b7e6ea3-ab44-41db-a901-28da56e3d0cb req-20d1bfde-ce9e-4472-bc2f-bc77b00e76c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 15:37:16.095390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.096077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.097477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.098277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.109701 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.compute.rpcapi [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 15:37:16.110983 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] Releasing lock "compute-rpcapi-router" {{(pid=123632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 15:37:16.142727 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-01eb127a-3039-4bb2-acc1-f61b78a4caf4 None None] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.551859 May 12 15:37:16.144075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 20/38] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:16.401421 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:37:16.402663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:37:16.408946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:37:16.409483 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:37:16.410255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:37:16.430725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.431302 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.432170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.450021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.582216 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:37:16.604305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:16.608061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:16.615737 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for user ee73f971f9844c85bd9b29749554dc37 and project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:37:16.631509 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.632388 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.643630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:16.649215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:16.707051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:37:16.723449 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:37:16.958660 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3f1dec17-89e9-4fe9-b95d-2045fdfa14aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.225998 May 12 15:37:16.959463 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 19/39] 10.222.0.89 () {62 vars in 1187 bytes} [Thu May 12 15:37:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 6228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 12 15:37:16.984733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1466280376", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d950ca3-1243-4fb1-a3b9-399d6873531e"}], "security_groups": [{"name": "tempest-securitygroup--1144247485"}], "key_name": "tempest-keypair-2147351746", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:17.581806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:17.592433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8b7f6f90-b536-4403-923f-dbe5b162047f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.992575 May 12 15:37:17.595814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 21/40] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:16 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:17.609972 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c13a55f1-f23d-4185-a407-3c8c89d274ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:17.616181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c13a55f1-f23d-4185-a407-3c8c89d274ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:17.740723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] validate_networks() for [('6d950ca3-1243-4fb1-a3b9-399d6873531e', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:37:17.843889 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c13a55f1-f23d-4185-a407-3c8c89d274ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:17.860207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c13a55f1-f23d-4185-a407-3c8c89d274ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:17.862888 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c13a55f1-f23d-4185-a407-3c8c89d274ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:17.866256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c13a55f1-f23d-4185-a407-3c8c89d274ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1281 microversion: 2.20 time: 0.266216 May 12 15:37:17.867385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 22/41] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:17 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1281 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:18.621216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:18.622612 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:18.634301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:18.637080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:18.638284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:18.638911 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:19.475670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:19.546763 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3a8ba170-7f47-4a3b-bc6d-93a4b40961e3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.934431 May 12 15:37:19.550660 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 23/42] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:18 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:19.576245 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:19.589417 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:19.604068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:19.605512 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:19.609345 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:19.610363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:19.816543 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:19.854173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:19.856572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:19.858388 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-be4f8556-6b5b-4885-b899-a392589a9dd4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1333 microversion: 2.20 time: 0.292067 May 12 15:37:19.875691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 24/43] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:19 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1333 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:20.001843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:37:20.002991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:37:20.003539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:37:20.004031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:37:20.004536 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:37:20.013421 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:20.013884 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:20.014707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:20.015252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:20.036488 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for project 8aba4b044dfa42cd8da55086ab774561. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:37:20.041448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for user 99d68f67eb8949e0b0878527f86ee683 and project 8aba4b044dfa42cd8da55086ab774561. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:37:20.055355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:37:20.057756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:37:20.133373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0228ecff-b05a-4083-ac88-f3defead6339 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.164971 May 12 15:37:20.143943 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 20/44] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:37:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 3176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:37:20.147972 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-94759535-7419-4ee2-8a9c-75e5a92a1955 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:20.148739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-94759535-7419-4ee2-8a9c-75e5a92a1955 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:20.355809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-94759535-7419-4ee2-8a9c-75e5a92a1955 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:20.362899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-94759535-7419-4ee2-8a9c-75e5a92a1955 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1238 microversion: 2.1 time: 0.219970 May 12 15:37:20.363470 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 25/45] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:20 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1238 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:20.572693 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:20.574591 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:20.591506 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:20.591963 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:20.592782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:20.593221 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:20.882283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:20.883515 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:20.891362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:20.892061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:20.894256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:20.895018 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:21.040944 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:21.050794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:21.053147 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:21.054560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8877cb8b-5990-47de-a72f-cb731f098b92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1339 microversion: 2.20 time: 0.176772 May 12 15:37:21.062213 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 26/46] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:20 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:37:21.180454 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:21.196918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7e6a182f-cf15-4ece-ba06-dc1d4a5386fc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.632701 May 12 15:37:21.198112 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 21/47] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:20 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:21.380751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:21.381714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:21.395333 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:21.396267 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:21.397288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:21.397739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:21.518181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:21.530902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-69efbdcb-83bb-48e4-b622-b17d418b1c77 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1234 microversion: 2.1 time: 0.151782 May 12 15:37:21.534149 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 27/48] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:21 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1234 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:22.074901 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:22.075777 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:22.083903 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:22.088429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:22.089555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:22.096820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:22.214709 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:22.216075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:22.226373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:22.227056 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:22.229101 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:22.233364 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:22.259843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:22.276386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:22.281825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:22.281951 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1bebeba4-fe4f-493e-9ab3-b0905c31cc58 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1339 microversion: 2.20 time: 0.212309 May 12 15:37:22.282614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 22/49] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:22 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:22.548106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:22.550972 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:22.561537 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:22.566594 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:22.567335 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:22.567778 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:22.766742 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:22.769344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:22.776159 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c5cafcdb-faa2-4690-9c24-5ebbb69e86b5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.565456 May 12 15:37:22.781243 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1208b128-f620-419a-909e-c1a9d561c03e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1296 microversion: 2.1 time: 0.237705 May 12 15:37:22.783440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 28/50] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:22 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:22.792277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 23/51] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:22 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1296 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:23.300801 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:23.302120 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:23.308849 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:23.309613 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:23.310608 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:23.311115 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:23.464520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:23.473211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:23.474255 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:23.475644 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0d6ef157-8b26-48ce-bfa1-87bd16f8fae6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.178712 May 12 15:37:23.476956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 29/52] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:23 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:23.799063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:23.800112 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:23.806443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:23.806892 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:23.808452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:23.808452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:23.813477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:23.815127 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:23.826803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:23.827261 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:23.828036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:23.828505 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:24.065362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:24.065831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:24.077195 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3b88de34-21a7-4583-93aa-0b0a09a8639c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.281919 May 12 15:37:24.077902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-da637a52-18f2-43f2-8982-a250813c331b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.268164 May 12 15:37:24.078036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 24/53] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:23 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:24.078985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 30/54] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:23 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:24.495660 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:24.496592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:24.503232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:24.503907 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:24.512813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:24.513345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:24.655771 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:24.663843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:24.665410 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:24.666509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1d2cda4e-efeb-4bce-9bdf-e895c380770e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.176147 May 12 15:37:24.667492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 25/55] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:24 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:25.094461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:25.095063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:25.095215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:25.095850 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:25.101004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:25.101468 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:25.102761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:25.103069 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:25.103300 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:25.103557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:25.104395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:25.104915 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:25.372233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:25.382222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-789db36f-f9a5-40c9-9ba9-9e7cb8d669f5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.291646 May 12 15:37:25.382987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 31/56] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:25 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:25.423893 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:25.432497 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-24ef890e-6b5f-4c75-9b81-8f8af67f1f0c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.341199 May 12 15:37:25.433295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 26/57] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:25 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:25.691419 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:25.692286 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:25.698652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:25.699277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:25.700189 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:25.700817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:25.953649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:25.964623 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:25.966947 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:25.968932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e7a48598-b1b8-4c15-9cc7-521ef7a2817c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.284540 May 12 15:37:25.970191 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 32/58] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:25 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:26.221436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-83a95cf3-6aa1-4128-a4b9-3bfa20e030d9 req-11cfe11a-d1d2-414d-850f-c9e3dd6601b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be73f585-3978-4a35-b794-ccafc28dd120", "tag": "b2e2caaf-0b7c-4bb6-abe2-83c670e57c31"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:26.239091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-83a95cf3-6aa1-4128-a4b9-3bfa20e030d9 req-11cfe11a-d1d2-414d-850f-c9e3dd6601b9 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.239698 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-83a95cf3-6aa1-4128-a4b9-3bfa20e030d9 req-11cfe11a-d1d2-414d-850f-c9e3dd6601b9 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.268397 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-83a95cf3-6aa1-4128-a4b9-3bfa20e030d9 req-11cfe11a-d1d2-414d-850f-c9e3dd6601b9 service nova] Creating event network-changed:b2e2caaf-0b7c-4bb6-abe2-83c670e57c31 for instance be73f585-3978-4a35-b794-ccafc28dd120 on hv-cinder-83588 May 12 15:37:26.270796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-83a95cf3-6aa1-4128-a4b9-3bfa20e030d9 req-11cfe11a-d1d2-414d-850f-c9e3dd6601b9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 15:37:26.271769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.272333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.273231 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.273581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.288874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.compute.rpcapi [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 15:37:26.289999 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] Releasing lock "compute-rpcapi-router" {{(pid=123633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 15:37:26.312761 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-61531f8a-ff79-4d4f-a373-9846a28a8c37 None None] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192526 May 12 15:37:26.313921 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 27/59] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:26.389003 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-7364a071-31aa-42f0-9a3b-5981aa6bfef1 req-78780c34-43ec-4f3b-8286-2915781c34d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:26.404817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-7364a071-31aa-42f0-9a3b-5981aa6bfef1 req-78780c34-43ec-4f3b-8286-2915781c34d1 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.405262 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-7364a071-31aa-42f0-9a3b-5981aa6bfef1 req-78780c34-43ec-4f3b-8286-2915781c34d1 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.405854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:26.406584 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:26.418355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.418536 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-7364a071-31aa-42f0-9a3b-5981aa6bfef1 req-78780c34-43ec-4f3b-8286-2915781c34d1 service nova] Creating event network-changed:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:37:26.419690 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.420672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.421784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.423990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-7364a071-31aa-42f0-9a3b-5981aa6bfef1 req-78780c34-43ec-4f3b-8286-2915781c34d1 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041533 May 12 15:37:26.424802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 33/60] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:26.474069 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:26.474690 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:26.483510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.483955 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.484776 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.485205 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.624380 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:26.632164 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-73b1e6fe-19b6-4618-90b7-13a184dd1874 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.235550 May 12 15:37:26.642661 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 28/61] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:26 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:26.670028 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:26.677852 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4647229d-6722-4396-b360-4059687f9d5c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.214866 May 12 15:37:26.687508 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 34/62] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:26 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:26.987299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:26.987849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:26.994465 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.994917 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:26.995658 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:26.996109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:27.125015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:27.132946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:27.134563 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:27.135673 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5c18e197-fb78-43cf-b0dc-82c9567f53e4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.152393 May 12 15:37:27.136242 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 29/63] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:26 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:27.655387 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:27.656397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:27.667004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:27.667780 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:27.669098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:27.670458 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:27.695181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:27.695837 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:27.702009 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:27.702447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:27.703379 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:27.704024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:27.869560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:27.877513 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e517559d-0a93-4a97-9f4e-0a87a9f94c7c tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.229556 May 12 15:37:27.878179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 35/64] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:27 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:27.880366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:27.888251 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1629f8ce-fa4f-41c4-828e-0a95a8e75adc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.196893 May 12 15:37:27.888861 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 30/65] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:27 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:28.154173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:28.154776 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:28.161664 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:28.162116 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:28.162878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:28.163315 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:28.375571 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:28.384984 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:28.386914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:28.388394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-54dde553-348b-41b4-901a-c5fd0b6092c5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.238213 May 12 15:37:28.389110 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 36/66] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:28 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:28.895162 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:28.895779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:28.904256 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:28.905470 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:28.906256 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:28.906693 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:28.910043 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:28.910667 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:28.917490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:28.917947 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:28.918733 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:28.919639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:29.100898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:29.104195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:29.109327 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-375a11cd-c0e0-4471-98d3-ac4f8e0a9350 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.218824 May 12 15:37:29.110009 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 31/67] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:28 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:29.112028 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-76ece833-f870-40aa-9444-9a16a20ec968 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.210068 May 12 15:37:29.112644 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 37/68] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:28 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:29.177918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-7e8d4a24-1549-4d56-b955-d9bc48931952 req-ef37e8b3-50cb-4bb9-8428-39e04f5bd4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7e88b1-4973-431a-adfb-49a2d837ca0c", "name": "network-vif-plugged", "status": "completed", "tag": "c2c5418a-5981-4611-a818-0337a7b7c9d6"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:29.186249 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-7e8d4a24-1549-4d56-b955-d9bc48931952 req-ef37e8b3-50cb-4bb9-8428-39e04f5bd4a9 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:29.186687 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-7e8d4a24-1549-4d56-b955-d9bc48931952 req-ef37e8b3-50cb-4bb9-8428-39e04f5bd4a9 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:29.197869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-7e8d4a24-1549-4d56-b955-d9bc48931952 req-ef37e8b3-50cb-4bb9-8428-39e04f5bd4a9 service nova] Creating event network-vif-plugged:c2c5418a-5981-4611-a818-0337a7b7c9d6 for instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c on hv-cinder-83588 May 12 15:37:29.203197 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-7e8d4a24-1549-4d56-b955-d9bc48931952 req-ef37e8b3-50cb-4bb9-8428-39e04f5bd4a9 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085510 May 12 15:37:29.203781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 32/69] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:29.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:29.407207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:29.413882 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:29.414343 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:29.415195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:29.415646 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:29.551325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:29.562078 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:29.563809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:29.565184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6c14e182-2380-44bb-91c9-d85b3fa3deea tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.162539 May 12 15:37:29.565819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 38/70] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:29 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:30.131728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:30.132932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:30.133150 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:30.134054 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:30.140347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:30.140535 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:30.140826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:30.140967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:30.141592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:30.142015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:30.142172 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:30.142514 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:30.341585 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:30.345225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:30.349407 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e47b3e07-5c73-4c1b-91c2-b0df8f65820a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.222758 May 12 15:37:30.349978 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 39/71] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:30 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:30.353063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-96ea3a39-ccc0-4723-b29d-223eaafd5ecd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.228644 May 12 15:37:30.353781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 33/72] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:30 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:30.586440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:30.587265 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:30.593756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:30.594207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:30.594973 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:30.595413 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:30.725636 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:30.740825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:30.743541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:30.744679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7db79723-09a6-46ca-9667-3f14230746f4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.164535 May 12 15:37:30.745255 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 40/73] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:30 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:31.367219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:31.368128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:31.370119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:31.370728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:31.379959 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:31.380498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:31.381691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:31.381967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:31.382790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:31.383024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:31.383533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:31.383644 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:31.660873 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:31.670365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5c333670-debb-4ee0-be6f-9176e87ae50f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.304226 May 12 15:37:31.679810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 41/74] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:31 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:31.680336 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:31.683364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3a2124cc-d564-4d6c-a5f1-347b28a06157 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.320447 May 12 15:37:31.683916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 34/75] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:31 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:31.765593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:31.766775 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:31.777089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:31.777834 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:31.779078 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:31.779783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:31.923054 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:31.931038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:31.932648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:31.933826 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e3dcadcb-3d64-4ac8-8aab-b679ff491878 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.174865 May 12 15:37:31.934450 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 42/76] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:31 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:32.687198 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:32.687835 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:32.694439 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:32.694886 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:32.695728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:32.696150 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:32.700899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:32.701525 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:32.709370 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:32.709818 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:32.710591 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:32.711103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:32.894231 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:32.902121 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:32.902300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-639ff3b2-a9f7-4b2e-b7d2-119d2c10a5c8 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.218746 May 12 15:37:32.902716 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 35/77] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:32 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:32.911071 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0138358a-c586-4094-a68e-a494bb1c0bff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.213982 May 12 15:37:32.911775 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 43/78] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:32 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:32.950991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:32.951635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:32.957765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:32.958288 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:32.959096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:32.959598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:33.099344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:33.107766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:33.109300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:33.110364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6481d493-3d25-44ad-8ee3-27c580760a45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.163259 May 12 15:37:33.110963 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 36/79] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:32 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:33.925687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:33.926760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:33.936665 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:33.937653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:33.939774 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:33.940556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:33.941835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:33.942576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:33.947252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:33.947697 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:33.948507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:33.948953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:34.135159 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:34.138261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:34.142976 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-776b10b4-f286-4826-b86f-82f0dfc5ff01 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.225848 May 12 15:37:34.143522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 44/80] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:33 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:34.146244 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2dc1768d-8c40-46cf-8673-88d932bebfbb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.218757 May 12 15:37:34.146982 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 37/81] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:33 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:34.147908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:34.149579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:34.156136 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:34.156621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:34.157387 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:34.157817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:34.305397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:34.313807 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:34.315295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:34.316417 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-58cc13ec-8cc1-4b1f-b6d9-a10385992844 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.171941 May 12 15:37:34.317024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 45/82] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:34 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:35.160043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:35.160781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:35.163642 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:35.164355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:35.166929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:35.167375 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:35.168141 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:35.168578 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:35.171066 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:35.171559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:35.172246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:35.172709 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:35.356581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:35.363124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:35.364407 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-40b55ed5-42f4-423e-aa1d-2187bd8304a1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.208200 May 12 15:37:35.365140 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 38/83] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:35 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:35.369442 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:35.370059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:35.371612 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cba18482-137b-4aea-a29e-0aadcccc9b84 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.212368 May 12 15:37:35.372335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 46/84] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:35 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:35.376429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:35.376871 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:35.377611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:35.378019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:35.511714 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:35.520093 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:35.521620 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:35.522720 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1fcce3d1-2868-4b7d-98b6-01ca7659dfcd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.156775 May 12 15:37:35.523293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 39/85] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:35 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:36.385974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:36.386864 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:36.391517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:36.392533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:36.397443 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:36.398194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:36.399466 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:36.400198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:36.402504 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:36.403174 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:36.403943 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:36.404373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:36.592430 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:36.596268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:36.600031 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e4733757-b7da-466a-abce-51affbf8de3b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.220786 May 12 15:37:36.600687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 47/86] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:36 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:36.604243 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9a2a1797-6e3a-4ba6-8a93-b2318b7fcd53 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.219153 May 12 15:37:36.605001 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 40/87] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:36 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:36.605269 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:36.605864 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:36.615489 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:36.615941 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:36.616761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:36.617184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:36.750236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:36.759630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:36.761413 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:36.762831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-81e7ed07-9299-4c6f-9a8b-203c9cfca7fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.161130 May 12 15:37:36.763453 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 48/88] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:36 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:37.617366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:37.619505 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:37.627052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:37.627657 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:37.633552 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:37.633996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:37.634765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:37.635258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:37.643447 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:37.643949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:37.644761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:37.645195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:37.841528 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:37.848180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:37.851888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e6d306d4-6a5c-4964-b7fa-b44224bc9df6 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.238363 May 12 15:37:37.852592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 41/89] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:37 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:37.861605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-52c9aba4-627b-4fca-8b6d-a2f569327094 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.232425 May 12 15:37:37.861735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:37.861735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:37.864732 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:37.865182 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:37.865411 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 49/90] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:37 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:37.865991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:37.866514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:38.003110 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:38.014226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:38.015962 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:38.017815 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cd7d6ea2-b464-41a3-b88b-db05b4c57402 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.164131 May 12 15:37:38.018653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 42/91] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:37 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:38.870179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:38.870698 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:38.872879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:38.873511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:38.876780 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:38.877211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:38.878026 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:38.878455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:38.879614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:38.880070 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:38.880864 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:38.881303 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:39.068151 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:39.071511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:39.076038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c3daea38-b40a-49c4-b687-e75dd787cfa1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.209667 May 12 15:37:39.076684 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 50/92] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:38 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:39.079705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9cfa31c8-7e9d-4d54-bb55-9e5b4263771b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.210969 May 12 15:37:39.080521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 43/93] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:38 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:39.081241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:39.081829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:39.087773 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:39.088208 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:39.089000 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:39.089422 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:39.222381 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:39.230518 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:39.232114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:39.233253 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d0788357-475a-4691-bfd5-e7e3e3862953 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.155650 May 12 15:37:39.233867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 51/94] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:39 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:40.093686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:40.094298 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:40.096390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:40.097053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:40.100370 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:40.100857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:40.101682 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:40.102065 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:40.102947 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:40.103395 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:40.104144 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:40.104602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:40.294498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:40.301931 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:40.302555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-938cb318-fc19-4447-ba5e-6b4b0b007984 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.212881 May 12 15:37:40.303142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 44/95] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:40 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:40.310531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-09459d42-79a9-410e-aaef-c0acabc73c5e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.218005 May 12 15:37:40.311281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 52/96] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:40 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:40.317211 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:40.317808 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:40.324216 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:40.324458 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:40.325334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:40.325769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:40.519297 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:40.529366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:40.531277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:40.532817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-fb869ff2-0611-4184-8854-27a157a537f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.219387 May 12 15:37:40.543385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 45/97] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:40 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:41.319087 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:41.319675 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:41.325821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:41.326271 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:41.327045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:41.327458 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:41.327581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:41.328209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:41.337071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:41.337745 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:41.338667 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:41.339236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:41.541065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:41.546370 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:41.550035 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-09d4285e-d214-42fb-82cc-9da74faf717b tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.234738 May 12 15:37:41.550913 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 53/98] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:41 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:41.555429 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:41.556271 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:41.566227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f3b6e59d-3485-4060-9f4a-2790ace23994 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.242741 May 12 15:37:41.577011 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 46/99] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:41 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:41.580188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:41.580970 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:41.582554 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:41.583401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:41.726843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:41.734810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:41.736392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:41.737648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4a933488-cd46-4844-b347-c2df3f0c994c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.185821 May 12 15:37:41.738292 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 54/100] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:41 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:42.566993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:42.567498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:42.573642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:42.574091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:42.574976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:42.575408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:42.583287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:42.584025 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:42.590156 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:42.590806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:42.591788 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:42.592412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:42.882743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:42.890962 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3b45494c-1c34-45c2-bb86-4fad1738b8a3 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.327885 May 12 15:37:42.893201 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 47/101] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:42 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:42.897772 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:42.898379 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:42.904456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:42.905044 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:42.906284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:42.906784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:42.911352 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:42.921615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-28581197-661d-4ae2-80a2-2acd5ca771b7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.341873 May 12 15:37:42.923151 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 55/102] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:42 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:43.065358 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:43.076619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:43.081155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:43.082992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-62082e5d-5f9e-42d7-b6bb-a30e09b209be tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.188837 May 12 15:37:43.083735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 48/103] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:42 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:43.908892 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:43.910186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:43.917754 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:43.918220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:43.919488 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:43.919991 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:43.939082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:43.939691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:43.945907 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:43.946565 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:43.947499 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:43.948083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:44.119164 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:44.125581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:44.130990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-753fffef-c62c-45c8-845a-290a9a04679d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1314 microversion: 2.1 time: 0.225905 May 12 15:37:44.133603 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f83b3e7f-209c-4533-b13b-bb042b0cf70d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.198276 May 12 15:37:44.134929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 49/104] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:43 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:44.139976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:44.141110 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:44.145001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 56/105] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:43 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:44.148715 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:44.149610 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:44.150871 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:44.151507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:44.288406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:44.297487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:44.299065 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:44.300265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3bf69068-f903-440f-b1ea-c10adb8aa290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.164066 May 12 15:37:44.300932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 50/106] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:44 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:45.150196 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:45.150805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:45.157178 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:45.157460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:45.157929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:45.158459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:45.158689 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:45.159001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:45.174045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:45.174488 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:45.178733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:45.179188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:45.431247 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:45.436013 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:45.443634 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a47cfd20-7d27-4eef-81d6-f56b301e6ee1 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1500 microversion: 2.1 time: 0.298342 May 12 15:37:45.444684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-69272da0-bfd2-4d2f-961a-520c7aa89f19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.296894 May 12 15:37:45.445352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 51/107] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:45 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:45.446615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 57/108] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:45 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1500 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:45.469692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:45.469692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:45.470610 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:45.471101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:45.471915 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:45.472414 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:45.649712 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:45.660323 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:45.661852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:45.662977 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-55d8c099-30e3-447c-92b5-d28bbea4ab2c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.208902 May 12 15:37:45.663547 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 52/109] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:45 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:46.034575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-053ea966-a46e-43ba-b751-c5b8640067c9 req-b156bbae-cbac-42ca-9cd2-70c6a5c1eb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be73f585-3978-4a35-b794-ccafc28dd120", "name": "network-vif-plugged", "status": "completed", "tag": "b2e2caaf-0b7c-4bb6-abe2-83c670e57c31"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:46.043462 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-053ea966-a46e-43ba-b751-c5b8640067c9 req-b156bbae-cbac-42ca-9cd2-70c6a5c1eb28 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.044523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-053ea966-a46e-43ba-b751-c5b8640067c9 req-b156bbae-cbac-42ca-9cd2-70c6a5c1eb28 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:46.058665 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-053ea966-a46e-43ba-b751-c5b8640067c9 req-b156bbae-cbac-42ca-9cd2-70c6a5c1eb28 service nova] Creating event network-vif-plugged:b2e2caaf-0b7c-4bb6-abe2-83c670e57c31 for instance be73f585-3978-4a35-b794-ccafc28dd120 on hv-cinder-83588 May 12 15:37:46.064124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-053ea966-a46e-43ba-b751-c5b8640067c9 req-b156bbae-cbac-42ca-9cd2-70c6a5c1eb28 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 May 12 15:37:46.064895 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 58/110] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:37:46.463770 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:46.464673 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:46.480319 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.482533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:46.485459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.486115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:46.658256 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:46.666253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-25040d67-8545-41a3-a453-38d7cd77de3a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.208039 May 12 15:37:46.667168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 53/111] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:46 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:46.683111 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:46.684380 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:46.697077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.701153 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:46.702185 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.702621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:46.914067 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:46.923580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:46.925681 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:46.927875 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-26e3c6cb-244d-4bb8-82f5-a5eea51555c4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.248504 May 12 15:37:46.938608 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 59/112] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:46 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:46.959291 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "478e30e3-f6db-4e9d-ad59-856a65111d4c"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:46.960347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:46.966572 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.967129 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:46.967892 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:46.968378 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:47.684651 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:47.688805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:47.695165 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:47.695652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:47.696459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:47.696915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:47.888688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:47.898760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-827c0fa8-2484-40d3-a12d-d6aeeacfc4cb tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.218320 May 12 15:37:47.899384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 60/113] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:47 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:47.948087 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:47.948747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:47.954904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:47.955349 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:47.956116 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:47.956592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:48.093772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:48.101713 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:48.103185 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:48.104276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-70e92944-261e-43a6-842d-cf281a936d45 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.161042 May 12 15:37:48.105147 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 61/114] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:47 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:48.915451 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:48.916179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:48.923769 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:48.924318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:48.925475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:48.925923 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:49.074883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:49.082454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9749d539-0bda-48cb-9d49-39d822130f0f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.171107 May 12 15:37:49.084051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 62/115] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:48 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:37:49.122340 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:49.123449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:49.130293 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:49.131876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:49.132967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:49.134154 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:49.319929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:49.328108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:49.329635 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:49.330803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5ecf6395-df49-4aca-ad6c-c0aa599f582a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.212353 May 12 15:37:49.331365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 63/116] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:49 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:37:49.562329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c76872c9-c737-4a05-9330-a09dce610fb0 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "POST /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.607068 May 12 15:37:49.569290 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 54/117] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:37:46 2022] POST /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c/os-volume_attachments => generated 194 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:37:49.769005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-547c897a-6eec-467e-92fc-d79736b08fb1 req-76b2850a-c068-4c5d-ae54-2b3ec235b380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "name": "network-vif-plugged", "status": "completed", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:49.779044 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-547c897a-6eec-467e-92fc-d79736b08fb1 req-76b2850a-c068-4c5d-ae54-2b3ec235b380 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:49.779794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-547c897a-6eec-467e-92fc-d79736b08fb1 req-76b2850a-c068-4c5d-ae54-2b3ec235b380 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:49.793784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-547c897a-6eec-467e-92fc-d79736b08fb1 req-76b2850a-c068-4c5d-ae54-2b3ec235b380 service nova] Creating event network-vif-plugged:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:37:49.800219 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-547c897a-6eec-467e-92fc-d79736b08fb1 req-76b2850a-c068-4c5d-ae54-2b3ec235b380 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035097 May 12 15:37:49.801058 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 64/118] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:50.101619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:50.102357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:50.109385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:50.109924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:50.110775 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:50.111208 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:50.247280 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:50.255817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8ad3da1f-d3d4-4146-a5ad-27272b11fed0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1364 microversion: 2.1 time: 0.158378 May 12 15:37:50.256281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 55/119] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:50 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:50.349846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:50.350745 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:50.358162 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:50.358548 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:50.359314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:50.359740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:50.495212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:50.503207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:50.504908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:50.506207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2ffdbef7-bda5-4237-8461-7418f71271f2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.160584 May 12 15:37:50.506756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 65/120] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:50 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:51.276723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:51.276723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:51.282219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:51.282924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:51.283888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:51.284420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:51.524250 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:51.525041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:51.532168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:51.532671 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:51.533557 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:51.534604 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:51.687942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:51.695988 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-eda7aba7-b4e7-414e-bd9e-c80b7967a365 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1551 microversion: 2.1 time: 0.426921 May 12 15:37:51.696590 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 56/121] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:51 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1551 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:51.713831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:51.714299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:51.719392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:51.723492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:51.723939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:51.724727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:51.725159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:51.728175 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:51.730273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:51.731572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-99d8d779-758f-48dd-beb6-7796220cc54c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.211207 May 12 15:37:51.732166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 66/122] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:51 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:51.814700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7a948685-8512-4d96-9884-77f8f721d2d5 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104694 May 12 15:37:51.815393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 57/123] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:37:51 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:37:52.754403 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:52.755833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:52.765345 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:52.766096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:52.766875 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:52.767314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:52.904796 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:52.916037 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:52.917919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:52.919587 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7bb4d921-cd52-4412-9fe0-85cd448a2c1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.171535 May 12 15:37:52.927094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 67/124] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:52 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:53.231854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-ebddb271-8bad-4184-95ee-d15c5b8fcb30 req-fc16b54b-bb07-4a0a-8065-b94dcff6e693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be73f585-3978-4a35-b794-ccafc28dd120", "tag": "b2e2caaf-0b7c-4bb6-abe2-83c670e57c31"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:37:53.240577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-ebddb271-8bad-4184-95ee-d15c5b8fcb30 req-fc16b54b-bb07-4a0a-8065-b94dcff6e693 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:53.241022 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-ebddb271-8bad-4184-95ee-d15c5b8fcb30 req-fc16b54b-bb07-4a0a-8065-b94dcff6e693 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:53.252072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-ebddb271-8bad-4184-95ee-d15c5b8fcb30 req-fc16b54b-bb07-4a0a-8065-b94dcff6e693 service nova] Creating event network-changed:b2e2caaf-0b7c-4bb6-abe2-83c670e57c31 for instance be73f585-3978-4a35-b794-ccafc28dd120 on hv-cinder-83588 May 12 15:37:53.257028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-ebddb271-8bad-4184-95ee-d15c5b8fcb30 req-fc16b54b-bb07-4a0a-8065-b94dcff6e693 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029087 May 12 15:37:53.257612 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 58/125] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:37:53.940461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:53.941143 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:53.947229 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:53.947608 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:53.948564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:53.949026 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:54.085594 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:54.094560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:54.096204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:54.097349 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-41513c9d-c9da-4301-9b0f-7f1b18bd6964 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.161565 May 12 15:37:54.097953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 68/126] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:53 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:55.122061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:55.122888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:55.129581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:55.130228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:55.131155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:55.131589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:55.269236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:55.277557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:55.279107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:55.280435 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-045161be-01e4-4946-8cf1-a4a4ef3ffd9b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.166191 May 12 15:37:55.281002 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 59/127] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:55 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:56.299305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:56.299917 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:56.306201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:56.307021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:56.307799 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:56.308237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:56.443377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:56.451769 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:56.453508 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:56.454933 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f5d1fe49-3717-4501-9e02-9d73bc27e0b3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.160578 May 12 15:37:56.455778 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 69/128] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:56 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:57.473913 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:57.474525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:57.484724 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:57.485178 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:57.486505 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:57.487272 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:57.628877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:57.640638 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:57.642854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:57.644548 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-feefcf91-7568-43e8-abb3-9f2e3f09d6c7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.175157 May 12 15:37:57.645429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 60/129] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:57 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:58.665656 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:58.666263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:58.672832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:58.673277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:58.674027 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:58.674452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:58.816004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:58.825080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:58.826575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:58.827668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9669d908-6e26-43b7-a78c-38b5a5056c8f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1406 microversion: 2.20 time: 0.165864 May 12 15:37:58.828234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 70/130] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:58 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:37:59.272136 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:59.272683 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:59.279285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:59.279745 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:59.280536 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:59.280972 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:59.308218 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:37:59.406674 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a90f9147-f0ac-4b00-9a7b-ee59c639e71d tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "DELETE /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 204 len: 0 microversion: 2.1 time: 0.138067 May 12 15:37:59.408926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 61/131] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:37:59 2022] DELETE /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:37:59.417118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:59.417777 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:59.426308 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:59.426716 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:59.427521 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:59.428027 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:59.650290 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:37:59.659321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ff2f538c-870c-4047-9b75-9a779c524ffc tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1552 microversion: 2.1 time: 0.247326 May 12 15:37:59.660097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 71/132] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:37:59 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:37:59.846123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:37:59.846829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:37:59.852681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:59.853326 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:59.854106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:37:59.854543 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:37:59.994168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:00.003407 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:00.005233 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:00.006420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cf818e35-5103-41b6-89be-488600484256 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1596 microversion: 2.20 time: 0.164625 May 12 15:38:00.006971 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 62/133] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:37:59 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1596 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:38:00.026793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:00.028563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:00.036649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:00.038881 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:00.040181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:00.040674 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:00.174418 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-801ef40f-daf0-4170-b871-6b7d88a47661 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151897 May 12 15:38:00.175015 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 72/134] 10.222.0.89 () {60 vars in 1315 bytes} [Thu May 12 15:38:00 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:38:00.679842 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:00.681172 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:00.691660 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:00.692987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:00.694171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:00.694999 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:01.378139 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:01.392040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c0a37327-db39-4894-8e68-8db9b32e2fe5 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1552 microversion: 2.1 time: 0.716630 May 12 15:38:01.393564 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 63/135] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:00 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1552 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:02.322587 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-a4fc80e0-5588-4434-b53e-e042be113da3 req-3b584b97-eb52-4846-b49c-8674c2201ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:02.338860 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-a4fc80e0-5588-4434-b53e-e042be113da3 req-3b584b97-eb52-4846-b49c-8674c2201ea3 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:02.339310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-a4fc80e0-5588-4434-b53e-e042be113da3 req-3b584b97-eb52-4846-b49c-8674c2201ea3 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:02.380226 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-a4fc80e0-5588-4434-b53e-e042be113da3 req-3b584b97-eb52-4846-b49c-8674c2201ea3 service nova] Creating event network-changed:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:38:02.387843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-a4fc80e0-5588-4434-b53e-e042be113da3 req-3b584b97-eb52-4846-b49c-8674c2201ea3 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068978 May 12 15:38:02.390590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 73/136] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:02.415954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:02.417505 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:02.438950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:02.439316 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:02.440127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:02.440586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:02.769343 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:02.778171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8fc45f54-5f1b-4398-9ddf-95bf02731f45 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1552 microversion: 2.1 time: 0.370813 May 12 15:38:02.778768 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 64/137] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:02 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1552 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:03.799496 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:03.801979 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:03.817965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:03.819254 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:03.822633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:03.823309 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:03.885004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:03.885716 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:03.886317 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lazy-loading 'fault' on Instance uuid 6a7e88b1-4973-431a-adfb-49a2d837ca0c {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:38:03.999821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae507741bc8648d382b906009d6f0392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc278e450c714353be7f27fa08069574', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:04.007226 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a02c3730-1fb0-4a5a-ad02-aeaed03c2846 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 200 len: 1304 microversion: 2.1 time: 0.214792 May 12 15:38:04.009392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 74/138] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:03 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 1304 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:04.413258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-a63f4ffc-9a61-42fe-9b33-d6671016f538 req-014e6a10-16ea-4a23-af43-bf28590fec52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7e88b1-4973-431a-adfb-49a2d837ca0c", "name": "network-vif-deleted", "tag": "c2c5418a-5981-4611-a818-0337a7b7c9d6"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:04.422159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-a63f4ffc-9a61-42fe-9b33-d6671016f538 req-014e6a10-16ea-4a23-af43-bf28590fec52 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:04.422940 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-a63f4ffc-9a61-42fe-9b33-d6671016f538 req-014e6a10-16ea-4a23-af43-bf28590fec52 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:04.437720 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-a63f4ffc-9a61-42fe-9b33-d6671016f538 req-014e6a10-16ea-4a23-af43-bf28590fec52 service nova] Creating event network-vif-deleted:c2c5418a-5981-4611-a818-0337a7b7c9d6 for instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c on hv-cinder-83588 May 12 15:38:04.443070 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-a63f4ffc-9a61-42fe-9b33-d6671016f538 req-014e6a10-16ea-4a23-af43-bf28590fec52 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033593 May 12 15:38:04.443887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 65/139] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:05.025755 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:05.026350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:05.032672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:05.033649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:05.035279 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:05.036637 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:05.056906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] HTTP exception thrown: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Request method failure captured: May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c HTTP/1.1 May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmYJDagatz9SqPQHF-DZpCNfSy5m9ta-RKRJoOTR2vnPFT6cmJgNPg3VoYtMQoGqsLLBkh-qYIDHD5V-QxXKlNvztk7OtJSWMJFiMB2uRv3YNFaBzC8Wb_pRRyQ2s7cNbrJeOi9vTd8owK9Wz5WDZjD73eNUl2z3AtLVx5xE0I0N8Q May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:38:05.062118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_dc278e450c714353be7f27fa08069574", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/dc278e450c714353be7f27fa08069574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-DeleteServersTestJSON-317511449 May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ae507741bc8648d382b906009d6f0392 May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.063329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '6a7e88b1-4973-431a-adfb-49a2d837ca0c'} May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:38:05.064163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.065276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:05.067804 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Returning 404 to user: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:38:05.068785 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5e62a486-e2a1-4ce5-9300-d5f393e20f27 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 404 len: 111 microversion: 2.1 time: 0.046824 May 12 15:38:05.069870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 75/140] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:05 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:38:05.215014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:05.216053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:05.225902 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:05.226332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:05.227107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:05.227543 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:05.248785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] HTTP exception thrown: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Request method failure captured: May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c/os-volume_attachments HTTP/1.1 May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSmYJDagatz9SqPQHF-DZpCNfSy5m9ta-RKRJoOTR2vnPFT6cmJgNPg3VoYtMQoGqsLLBkh-qYIDHD5V-QxXKlNvztk7OtJSWMJFiMB2uRv3YNFaBzC8Wb_pRRyQ2s7cNbrJeOi9vTd8owK9Wz5WDZjD73eNUl2z3AtLVx5xE0I0N8Q May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:38:05.249507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_dc278e450c714353be7f27fa08069574", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/dc278e450c714353be7f27fa08069574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-DeleteServersTestJSON-317511449 May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ae507741bc8648d382b906009d6f0392 May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.250651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'server_id': '6a7e88b1-4973-431a-adfb-49a2d837ca0c'} May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:38:05.251300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:05.252395 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:05.255122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Returning 404 to user: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:38:05.256063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cefcfe3b-d6f3-47e9-bf58-644cb8843324 tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046599 May 12 15:38:05.256742 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 66/141] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:38:05 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:38:06.682373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:06.683276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:06.696497 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:06.697227 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:06.698068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:06.698497 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:06.722296 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] HTTP exception thrown: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Request method failure captured: May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c HTTP/1.1 May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmYJDagatz9SqPQHF-DZpCNfSy5m9ta-RKRJoOTR2vnPFT6cmJgNPg3VoYtMQoGqsLLBkh-qYIDHD5V-QxXKlNvztk7OtJSWMJFiMB2uRv3YNFaBzC8Wb_pRRyQ2s7cNbrJeOi9vTd8owK9Wz5WDZjD73eNUl2z3AtLVx5xE0I0N8Q May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:38:06.725335 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_dc278e450c714353be7f27fa08069574", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/dc278e450c714353be7f27fa08069574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-DeleteServersTestJSON-317511449 May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ae507741bc8648d382b906009d6f0392 May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.726766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '6a7e88b1-4973-431a-adfb-49a2d837ca0c'} May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:38:06.727573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.728711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:38:06.732060 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Returning 404 to user: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:38:06.733221 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b070ac0f-67e1-4461-944b-b2b242857a2f tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "DELETE /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 404 len: 111 microversion: 2.1 time: 0.056106 May 12 15:38:06.734140 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 76/142] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:38:06 2022] DELETE /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:38:06.743316 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:06.744240 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] [instance: 6a7e88b1-4973-431a-adfb-49a2d837ca0c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:06.753726 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:06.754597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:06.763966 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:06.763966 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:06.785451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] HTTP exception thrown: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Request method failure captured: May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c HTTP/1.1 May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSmYJDagatz9SqPQHF-DZpCNfSy5m9ta-RKRJoOTR2vnPFT6cmJgNPg3VoYtMQoGqsLLBkh-qYIDHD5V-QxXKlNvztk7OtJSWMJFiMB2uRv3YNFaBzC8Wb_pRRyQ2s7cNbrJeOi9vTd8owK9Wz5WDZjD73eNUl2z3AtLVx5xE0I0N8Q May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:38:06.788451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_dc278e450c714353be7f27fa08069574", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/dc278e450c714353be7f27fa08069574"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/dc278e450c714353be7f27fa08069574"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-DeleteServersTestJSON-317511449 May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: dc278e450c714353be7f27fa08069574 May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-DeleteServersTestJSON-317511449 May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ae507741bc8648d382b906009d6f0392 May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-DeleteServersTestJSON-317511449-project May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.789989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '6a7e88b1-4973-431a-adfb-49a2d837ca0c'} May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:38:06.790918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. May 12 15:38:06.791978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:38:06.793655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] Returning 404 to user: Instance 6a7e88b1-4973-431a-adfb-49a2d837ca0c could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:38:06.793655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4eb98dc4-b35d-4580-8d1d-3b78decd1abd tempest-DeleteServersTestJSON-317511449 tempest-DeleteServersTestJSON-317511449-project] 10.222.0.89 "GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c" status: 404 len: 111 microversion: 2.1 time: 0.053153 May 12 15:38:06.796586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 67/143] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:06 2022] GET /compute/v2.1/servers/6a7e88b1-4973-431a-adfb-49a2d837ca0c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:38:14.419530 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-560496886", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:14.474352 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] validate_networks() for [('face382c-cf88-455e-a792-36e0eb4696a1', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:38:14.865179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:38:14.865572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:38:14.866072 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:38:14.866479 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:38:14.866889 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:38:14.875574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:14.876024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:14.876858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:14.877472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:14.895286 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:38:14.899261 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for user eaf5525a857c46ca9000626e60136eb9 and project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:38:14.910043 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:38:14.912402 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:38:14.959263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-dc82f557-0f69-4574-afdf-51d8f4284420 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.664734 May 12 15:38:14.960009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 77/144] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:38:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 15:38:14.969849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-89907541-ae06-4628-ab7e-aee533bda278 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:14.971178 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-89907541-ae06-4628-ab7e-aee533bda278 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:15.038268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-89907541-ae06-4628-ab7e-aee533bda278 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:15.045652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-89907541-ae06-4628-ab7e-aee533bda278 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1221 microversion: 2.1 time: 0.079700 May 12 15:38:15.046278 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 68/145] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:14 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:15.120285 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1383079559", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:15.191876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] validate_networks() for [('face382c-cf88-455e-a792-36e0eb4696a1', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:38:16.097987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:38:16.098605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:38:16.098846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:38:16.099425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:38:16.100060 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:38:16.111626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:16.112348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:16.114133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:16.114842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:16.135198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:38:16.139962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for user eaf5525a857c46ca9000626e60136eb9 and project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:38:16.158737 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:38:16.161779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:38:16.228870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1917ee12-2d56-4c08-a6ac-0e413dbad6aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.114359 May 12 15:38:16.229777 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 78/146] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:38:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:38:16.239699 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-be90b20b-e138-407a-8752-039b52b15f7f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:16.240304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-be90b20b-e138-407a-8752-039b52b15f7f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:16.311643 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-be90b20b-e138-407a-8752-039b52b15f7f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:16.318794 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-be90b20b-e138-407a-8752-039b52b15f7f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1222 microversion: 2.1 time: 0.082862 May 12 15:38:16.330205 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 69/147] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:16 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:17.337860 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:17.338621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:17.350589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:17.353090 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:17.354286 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:17.358277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:17.643871 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:17.660049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bc40b4b8-0e03-4c07-aa04-1ebba3044d3e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1274 microversion: 2.1 time: 0.323480 May 12 15:38:17.660803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 79/148] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:17 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:18.678274 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:18.678972 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:18.694354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:18.695023 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:18.696010 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:18.697830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:18.926949 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:18.945839 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-157f3b9b-990d-4006-91c8-d688022c21aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1280 microversion: 2.1 time: 0.271211 May 12 15:38:18.951012 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 70/149] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:18 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:19.391461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-8ac451c0-6d38-42ac-909f-19776cf51cf7 req-5ccc54db-1640-481f-9d1c-4ef776277121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f2fa5c-7d16-4c2e-978e-c63f357f460f", "tag": "bb4489c9-042d-4dc5-8442-2157497a78a3"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:19.434362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8ac451c0-6d38-42ac-909f-19776cf51cf7 req-5ccc54db-1640-481f-9d1c-4ef776277121 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:19.434760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8ac451c0-6d38-42ac-909f-19776cf51cf7 req-5ccc54db-1640-481f-9d1c-4ef776277121 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:19.490143 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-8ac451c0-6d38-42ac-909f-19776cf51cf7 req-5ccc54db-1640-481f-9d1c-4ef776277121 service nova] Creating event network-changed:bb4489c9-042d-4dc5-8442-2157497a78a3 for instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f on hv-cinder-83588 May 12 15:38:19.510130 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-8ac451c0-6d38-42ac-909f-19776cf51cf7 req-5ccc54db-1640-481f-9d1c-4ef776277121 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121513 May 12 15:38:19.512596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 80/150] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:19.968716 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:19.969290 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:19.983008 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:19.983512 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:19.987003 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:19.987503 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:20.461480 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:20.473891 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-fb8e78b1-b770-4aa5-b851-9df16dd86312 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.510396 May 12 15:38:20.474847 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 71/151] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:19 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:21.339581 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-ed960799-0436-4484-8e31-15d7499a64d5 req-54855e12-9662-4121-8b00-584369bd0308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08d195c-139d-4504-9584-6d6cdda60bc2", "tag": "5c5b0249-be7e-446e-bb63-8151deda53b2"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:21.359681 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-ed960799-0436-4484-8e31-15d7499a64d5 req-54855e12-9662-4121-8b00-584369bd0308 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:21.362313 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-ed960799-0436-4484-8e31-15d7499a64d5 req-54855e12-9662-4121-8b00-584369bd0308 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:21.379539 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-ed960799-0436-4484-8e31-15d7499a64d5 req-54855e12-9662-4121-8b00-584369bd0308 service nova] Creating event network-changed:5c5b0249-be7e-446e-bb63-8151deda53b2 for instance a08d195c-139d-4504-9584-6d6cdda60bc2 on hv-cinder-83588 May 12 15:38:21.387936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-ed960799-0436-4484-8e31-15d7499a64d5 req-54855e12-9662-4121-8b00-584369bd0308 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053120 May 12 15:38:21.389344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 81/152] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:21.492366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:21.493159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:21.500757 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:21.501209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:21.501986 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:21.509508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:21.893301 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:21.902801 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f0fe004e-03c9-4773-a93e-d4d9779e1767 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.415469 May 12 15:38:21.903814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 72/153] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:21 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:22.922229 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:22.923569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:22.930698 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:22.931153 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:22.932108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:22.932566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:23.073370 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:23.081268 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-90c827b0-735e-4c94-97a1-0546ed31bca1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.164568 May 12 15:38:23.081853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 82/154] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:22 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:24.100302 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:24.100964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:24.107626 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:24.108081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:24.108887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:24.109346 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:24.246711 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:24.254095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f34e13b7-b477-406a-8deb-15e1b376d2f4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.157693 May 12 15:38:24.254676 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 73/155] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:24 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:25.273319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:25.274406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:25.282809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:25.283264 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:25.284039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:25.284522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:25.416728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:25.425039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8b705249-408d-4894-98a9-2972f8feb695 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.157691 May 12 15:38:25.425649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 83/156] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:25 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:25.816906 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-646bf5b3-fd8f-424b-8728-9c8a1249d452 req-0032877c-33e2-4aed-80f0-8074262d3eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f2fa5c-7d16-4c2e-978e-c63f357f460f", "name": "network-vif-plugged", "status": "completed", "tag": "bb4489c9-042d-4dc5-8442-2157497a78a3"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:25.834086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-646bf5b3-fd8f-424b-8728-9c8a1249d452 req-0032877c-33e2-4aed-80f0-8074262d3eaf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:25.834652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-646bf5b3-fd8f-424b-8728-9c8a1249d452 req-0032877c-33e2-4aed-80f0-8074262d3eaf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:25.850328 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-646bf5b3-fd8f-424b-8728-9c8a1249d452 req-0032877c-33e2-4aed-80f0-8074262d3eaf service nova] Creating event network-vif-plugged:bb4489c9-042d-4dc5-8442-2157497a78a3 for instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f on hv-cinder-83588 May 12 15:38:25.856631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-646bf5b3-fd8f-424b-8728-9c8a1249d452 req-0032877c-33e2-4aed-80f0-8074262d3eaf service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043731 May 12 15:38:25.857277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 74/157] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:38:26.441909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:26.442535 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:26.448823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:26.449306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:26.450042 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:26.450480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:26.609401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:26.617475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d78d22f4-9330-41b2-865a-4a6b5693ad55 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.179631 May 12 15:38:26.628157 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 84/158] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:26 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:27.635883 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:27.637399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:27.648111 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:27.649169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:27.650291 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:27.650829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:27.867019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:27.881588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d05d4842-c873-4ac8-808b-3a2b7167407a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.246969 May 12 15:38:27.892011 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 75/159] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:27 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:28.898610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:28.899362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:28.907497 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:28.909195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:28.910618 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:28.911356 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:29.195630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:29.212219 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-84a31c33-1f2b-46ac-a255-3648b514e2a7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.317276 May 12 15:38:29.213067 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 85/160] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:28 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:30.095501 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-47c6dd46-6291-4764-8a4d-0e7acb65786c req-f84f934e-e4ca-4b3a-a1ca-f4a002853c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08d195c-139d-4504-9584-6d6cdda60bc2", "name": "network-vif-plugged", "status": "completed", "tag": "5c5b0249-be7e-446e-bb63-8151deda53b2"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:30.105489 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-47c6dd46-6291-4764-8a4d-0e7acb65786c req-f84f934e-e4ca-4b3a-a1ca-f4a002853c9a service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:30.105975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-47c6dd46-6291-4764-8a4d-0e7acb65786c req-f84f934e-e4ca-4b3a-a1ca-f4a002853c9a service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:30.126394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-47c6dd46-6291-4764-8a4d-0e7acb65786c req-f84f934e-e4ca-4b3a-a1ca-f4a002853c9a service nova] Creating event network-vif-plugged:5c5b0249-be7e-446e-bb63-8151deda53b2 for instance a08d195c-139d-4504-9584-6d6cdda60bc2 on hv-cinder-83588 May 12 15:38:30.133560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-47c6dd46-6291-4764-8a4d-0e7acb65786c req-f84f934e-e4ca-4b3a-a1ca-f4a002853c9a service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041741 May 12 15:38:30.134508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 76/161] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:30.230802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:30.231460 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:30.243418 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:30.245016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:30.248596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:30.249060 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:30.457836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:30.466991 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0c6708f7-721a-44b1-858e-35505704d805 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.239993 May 12 15:38:30.467894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 86/162] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:30 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:31.142821 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1286150603", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:31.197758 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] validate_networks() for None {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:38:31.487805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:31.488772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:31.497510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:31.498232 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:31.499316 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:31.499941 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:31.742638 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:38:31.743314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:38:31.744135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:38:31.744728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:38:31.745307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:38:31.760840 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:31.761891 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:31.763261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:31.764308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:31.785932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Getting quotas for project 800882e33dc54145a74fabd425152e03. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:38:31.790923 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Getting quotas for user 8cd41966b7ce4c6e8301ca16d05a7d63 and project 800882e33dc54145a74fabd425152e03. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:38:31.805521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:38:31.808984 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:38:31.857887 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:31.865608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-526110cf-42b1-4635-8a58-64f245f4ec55 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727423 May 12 15:38:31.866493 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 77/163] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:38:31.871766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bf1e8ef3-3508-4bf0-bdbb-b1440d40495f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1322 microversion: 2.1 time: 0.385758 May 12 15:38:31.871766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 87/164] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:31 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:31.888303 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-56655176-b488-4f61-99ab-e5e83a766521 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:31.889380 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-56655176-b488-4f61-99ab-e5e83a766521 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:31.970461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-56655176-b488-4f61-99ab-e5e83a766521 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:31.981294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-56655176-b488-4f61-99ab-e5e83a766521 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1215 microversion: 2.1 time: 0.097627 May 12 15:38:31.985183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 88/165] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:31 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:32.889850 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:32.890544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:32.901201 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:32.901887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:32.902735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:32.903357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:32.997859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:32.999225 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:33.006048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:33.006616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:33.007628 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:33.008287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:33.094593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:33.104045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:33.105950 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0e82d8dc-3c75-4e7b-a717-efefbc48f3c0 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1267 microversion: 2.1 time: 0.110113 May 12 15:38:33.106685 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 89/166] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:32 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:33.115163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-65fd5a84-b945-4ff6-9ab5-3decf0338d1f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1517 microversion: 2.1 time: 0.230973 May 12 15:38:33.115908 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 78/167] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:32 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:33.133042 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:33.134230 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:33.140837 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:33.141291 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:33.142071 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:33.142575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:33.167211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lazy-loading 'flavor' on Instance uuid a08d195c-139d-4504-9584-6d6cdda60bc2 {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:38:33.377876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-34dd193a-7932-4d3f-87dd-59bd04ee2329 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2/action" status: 200 len: 32 microversion: 2.1 time: 0.248846 May 12 15:38:33.378797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 90/168] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:38:33 2022] POST /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:38:33.397039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:33.397923 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:33.409319 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:33.409876 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:33.410875 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:33.411323 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:33.841932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:33.850784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-dad4996a-d18b-4a97-a347-2cadc2518f6a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.466363 May 12 15:38:33.851801 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 79/169] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:33 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:34.124638 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:34.125327 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:34.144689 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:34.144897 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:34.146762 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:34.170425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:34.255934 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:34.263414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7d9500e2-b615-457d-9185-f06536372acc tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1273 microversion: 2.1 time: 0.143884 May 12 15:38:34.263992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 91/170] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:34 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:34.868765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:34.869384 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:34.877184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:34.878415 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:34.879444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:34.880186 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:35.108866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:35.132586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-76990539-70d0-49e8-a0b9-c108ea2ad315 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.267606 May 12 15:38:35.138983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 80/171] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:34 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:35.280540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:35.281141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:35.289518 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:35.289961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:35.292746 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:35.293196 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:35.759589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:35.773861 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-95c66b61-2580-4285-93bb-e02f628827fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.493658 May 12 15:38:35.776189 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 92/172] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:35 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:35.810817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-364fe3a1-2b15-4699-a1c3-1582575912d7 req-62b003a1-3ebc-41cf-93c6-953f89069ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b7b2b2-7744-4fed-99f3-df96323e2c1a", "tag": "1f2d9f96-01a7-4c8b-bbbd-79bbb1b0a065"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:35.821366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-364fe3a1-2b15-4699-a1c3-1582575912d7 req-62b003a1-3ebc-41cf-93c6-953f89069ac0 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:35.822104 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-364fe3a1-2b15-4699-a1c3-1582575912d7 req-62b003a1-3ebc-41cf-93c6-953f89069ac0 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:35.840608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-364fe3a1-2b15-4699-a1c3-1582575912d7 req-62b003a1-3ebc-41cf-93c6-953f89069ac0 service nova] Creating event network-changed:1f2d9f96-01a7-4c8b-bbbd-79bbb1b0a065 for instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a on hv-cinder-83588 May 12 15:38:35.846509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-364fe3a1-2b15-4699-a1c3-1582575912d7 req-62b003a1-3ebc-41cf-93c6-953f89069ac0 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040561 May 12 15:38:35.847181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 81/173] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:36.157341 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:36.158119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:36.165630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:36.166642 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:36.167538 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:36.168200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:36.371343 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:36.381998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6eb44126-a4e9-46c5-ad90-d94d9463530b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.229867 May 12 15:38:36.382795 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 93/174] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:36 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:36.793444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:36.794622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:36.803105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:36.803560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:36.804345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:36.804826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:37.067410 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:37.077372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b8f25080-bd9a-442d-b722-0ee203f841d7 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.289391 May 12 15:38:37.078419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 82/175] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:36 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:37.401747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:37.402507 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:37.408725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:37.409608 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:37.410386 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:37.410817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:37.700073 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:37.712051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f30f9ba3-960a-4e45-b01d-75f6b8bbe61b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.316562 May 12 15:38:37.713874 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 94/176] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:37 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:38.093693 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:38.094977 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:38.101723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:38.102440 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:38.103433 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:38.104104 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:38.321346 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:38.332205 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d26c3cfb-43c5-4ca2-8ae9-20bf60ca94fd tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.242196 May 12 15:38:38.333533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 83/177] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:38 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:38.730143 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:38.730812 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:38.740457 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:38.740937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:38.762629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:38.763440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:39.085568 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:39.093669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1e733a46-aea7-4d1e-ac03-630125a961ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.367387 May 12 15:38:39.098910 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 95/178] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:38 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:39.349209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:39.349690 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:39.356173 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:39.356735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:39.357504 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:39.357930 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:39.664005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:39.672782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-59096416-e890-497b-a06f-8cb6b77a0572 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.326991 May 12 15:38:39.682388 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 84/179] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:39 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:39.994075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:39.995247 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:40.008843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:40.013555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:40.015186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:40.015772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:40.046531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f4f3ebb2-1174-4920-9bae-65fbc6303e43 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/ips" status: 200 len: 146 microversion: 2.1 time: 0.057822 May 12 15:38:40.048483 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 96/180] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:38:39 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/ips => generated 146 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:40.115938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:40.117031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:40.125890 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:40.127527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:40.128678 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:40.129318 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:40.299590 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:40.312405 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a97aa21c-7051-4d04-9b93-e140cbe92106 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.197165 May 12 15:38:40.313244 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 85/181] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:40 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:40.693152 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:40.693863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:40.707660 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:40.708106 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:40.708909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:40.709338 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:40.887955 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:40.897328 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-575a9ccf-2838-4af9-a0fd-920f3939a757 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.210157 May 12 15:38:40.897999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 97/182] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:40 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:41.330783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:41.332808 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:41.340520 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:41.341307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:41.342269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:41.342912 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:41.567785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:41.580519 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8c87dbad-b168-47f1-80a7-2edfcf5ef9dd tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.254102 May 12 15:38:41.591770 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 86/183] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:41 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:41.914878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:41.916386 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:41.923244 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:41.923751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:41.924768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:41.925409 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:42.145533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:42.153547 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9e2b5c1c-0914-4b37-93c1-52f14e9f96ef tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.242418 May 12 15:38:42.163187 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 98/184] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:41 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:42.598009 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:42.599377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:42.605926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:42.606782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:42.607787 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:42.608434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:43.033525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:43.043688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-65bc8c64-bfe7-4d4a-8219-4fac3c16199e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.449422 May 12 15:38:43.048393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 87/185] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:42 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:43.175783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:43.176564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:43.183436 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:43.184308 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:43.185552 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:43.187097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:43.430517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:43.441616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fbb1fb09-b8ab-45dd-931a-c19c27a091c8 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.270514 May 12 15:38:43.452135 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 99/186] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:43 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:44.061102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:44.061739 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:44.074620 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:44.075034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:44.078086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:44.078593 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:44.183937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e85dc85b-0ce5-4492-86b8-57229c4ae167"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:44.185321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:44.202700 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:44.206401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:44.207503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:44.209160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:44.377679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:44.389238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cfcfb35f-57fe-4b53-af16-eb42265c3b2f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.332047 May 12 15:38:44.389820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 88/187] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:44 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:44.458820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:44.459429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:44.469582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:44.470017 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:44.475091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:44.475810 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:44.709135 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c772d57b-9696-4005-8f53-6bee72cf6876 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527324 May 12 15:38:44.710943 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 100/188] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:38:44 2022] POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:38:44.813198 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:44.821795 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ff230503-ae71-448a-8177-7088e3897491 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.366807 May 12 15:38:44.824724 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 89/189] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:44 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:45.407810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:45.408961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:45.426507 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:45.438389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:45.444204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:45.445072 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:45.841210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:45.841823 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:45.851642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:45.852100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:45.852917 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:45.853352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:46.436088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:46.456086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:46.463109 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cbd43f08-a10d-4bbf-a4dc-e2bc561eae43 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 1.060189 May 12 15:38:46.463880 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-73d378c7-e401-4ea4-bc80-7b457c259a01 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.626507 May 12 15:38:46.467565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 101/190] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:45 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:46.467998 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 90/191] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:45 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:46.754373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-336ef2c1-da62-4d32-ae58-97553642eb47 req-96a2de0f-ae38-403f-a8bc-58016db62018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b7b2b2-7744-4fed-99f3-df96323e2c1a", "name": "network-vif-plugged", "status": "completed", "tag": "1f2d9f96-01a7-4c8b-bbbd-79bbb1b0a065"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:46.775702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-336ef2c1-da62-4d32-ae58-97553642eb47 req-96a2de0f-ae38-403f-a8bc-58016db62018 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:46.785321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-336ef2c1-da62-4d32-ae58-97553642eb47 req-96a2de0f-ae38-403f-a8bc-58016db62018 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:46.818709 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-336ef2c1-da62-4d32-ae58-97553642eb47 req-96a2de0f-ae38-403f-a8bc-58016db62018 service nova] Creating event network-vif-plugged:1f2d9f96-01a7-4c8b-bbbd-79bbb1b0a065 for instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a on hv-cinder-83588 May 12 15:38:46.828621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-336ef2c1-da62-4d32-ae58-97553642eb47 req-96a2de0f-ae38-403f-a8bc-58016db62018 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077978 May 12 15:38:46.830236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 102/192] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:38:47.482879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:47.483524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:47.488090 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:47.488814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:47.491628 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:47.492203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:47.493136 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:47.493657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:47.502824 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:47.503358 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:47.504187 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:47.504669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:47.770568 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:47.783993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1bd7f295-cdd5-4d49-a586-1f30d6b81059 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.304989 May 12 15:38:47.784621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 91/193] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:47 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:47.815794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:47.828968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d7a7476a-e564-43ba-9002-f6318c7b2709 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.345651 May 12 15:38:47.831426 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 103/194] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:47 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:48.197557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-744407c6-a439-4669-a732-d41d362e317d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Action: 'create', calling method: .version_select at 0x7f60d07a8940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1546602223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwWG1OdMDDu4VzUq9oOqO3lM8V+cnj74H4xl9QWXVtc9b4l3KQlpvJyfH3OqP0/Gq/5r6Ywf5DyJFMYeTH7AWZ3dcfXcW32IVQ9A3sFR8FblnZuR3X2TDm1Z0rCvfKgYA=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:48.212030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-744407c6-a439-4669-a732-d41d362e317d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for project 4b8824725a894bbcb17789008292c1e4. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:38:48.216784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-744407c6-a439-4669-a732-d41d362e317d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for user 73bfb098d5f04da9adb7ae1d30fd30b1 and project 4b8824725a894bbcb17789008292c1e4. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:38:48.243262 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-744407c6-a439-4669-a732-d41d362e317d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.389351 May 12 15:38:48.243861 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 92/195] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:38:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:48.806925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:48.808201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:48.816768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:48.817607 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:48.819061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:48.819725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:48.846991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:48.848373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:48.856529 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:48.857467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:48.859790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:48.860577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:49.036664 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:49.047492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d41cc33b-7b4c-4a4f-8ffa-d8d477e8b88a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.246541 May 12 15:38:49.048720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 104/196] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:48 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:49.225312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:49.234627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3ebce31b-b565-4be3-853b-c0731c4f2b43 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1315 microversion: 2.1 time: 0.392431 May 12 15:38:49.235219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 93/197] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:48 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:50.064433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:50.065393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:50.090379 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.090903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.091689 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.092118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.255707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:50.256585 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:50.268509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.271699 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.272856 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.273487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.309722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:50.320499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b4497aa9-7ec3-4e98-bbd7-8c3d8c607f99 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.259980 May 12 15:38:50.321273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 105/198] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:50 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:50.537772 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:50.549030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6629bdf4-8ada-435d-84bb-a733809bdd24 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1465 microversion: 2.1 time: 0.301157 May 12 15:38:50.550814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 94/199] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:50 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1465 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:50.743359 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:50.743858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:50.751518 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.752011 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.752814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.753691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.784702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:38:50.919961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2f4ace4d-aa6e-44ee-8379-bee69c1eb27a tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "DELETE /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 204 len: 0 microversion: 2.1 time: 0.181378 May 12 15:38:50.920697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 106/200] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:38:50 2022] DELETE /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:38:50.931849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:50.932825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:50.961342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.961342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:50.961342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:50.961342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:51.245879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:51.255628 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-eeffd7fb-01ec-473f-bbae-a5b41abaae47 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1471 microversion: 2.1 time: 0.328967 May 12 15:38:51.256391 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 95/201] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:50 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:51.339480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:51.340798 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:51.359835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:51.360318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:51.361153 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:51.361593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:51.575639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:51.584793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-127f7567-32f6-41be-9d81-cca989ab33e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.250178 May 12 15:38:51.585910 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 107/202] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:51 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:51.889214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-119443495", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "networks": [{"uuid": "144446a1-8b69-4758-9c58-572c887f90d4"}]}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:52.273744 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:52.274842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:52.281842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:52.282580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:52.283544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:52.283978 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:52.428387 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:52.439088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f14866fa-d569-43a9-a74b-6c233ce6c9e4 tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1471 microversion: 2.1 time: 0.168095 May 12 15:38:52.439692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 108/203] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:52 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:52.603441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:52.604098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:52.616378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:52.616859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:52.617851 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:52.618308 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:52.802016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:52.811227 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fb722c0a-b0b7-4f8b-be22-3e4613325607 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.211805 May 12 15:38:52.812043 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 109/204] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:52 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:53.461161 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:53.462507 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:53.472290 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:53.473043 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:53.474219 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:53.475010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:53.668339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:53.677119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0758b672-d90d-4a4d-b0cb-50900a8fb2bb tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1471 microversion: 2.1 time: 0.224200 May 12 15:38:53.677782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 110/205] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:53 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:53.828314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:53.829184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:53.843330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:53.843330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:53.843330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:53.843330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.000969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:54.009535 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8a91f17f-728e-425f-92f7-190a72b456c6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.185215 May 12 15:38:54.016183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 111/206] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:53 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:38:54.016183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1137763b-b86b-4000-8349-7a6a9387694b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:54.021873 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1137763b-b86b-4000-8349-7a6a9387694b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.022574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1137763b-b86b-4000-8349-7a6a9387694b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.099487 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1137763b-b86b-4000-8349-7a6a9387694b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Going to try to stop instance {{(pid=123632) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 15:38:54.147484 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1137763b-b86b-4000-8349-7a6a9387694b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action" status: 202 len: 0 microversion: 2.1 time: 0.135713 May 12 15:38:54.148251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 112/207] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:38:54 2022] POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:38:54.153319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-e06e52e5-df8c-45df-bb78-1487984a06f1 req-4aba8273-bb1d-4677-a7e5-211381b25177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b7b2b2-7744-4fed-99f3-df96323e2c1a", "name": "network-vif-deleted", "tag": "1f2d9f96-01a7-4c8b-bbbd-79bbb1b0a065"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:38:54.162546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-e06e52e5-df8c-45df-bb78-1487984a06f1 req-4aba8273-bb1d-4677-a7e5-211381b25177 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.162977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-e06e52e5-df8c-45df-bb78-1487984a06f1 req-4aba8273-bb1d-4677-a7e5-211381b25177 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.177645 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-e06e52e5-df8c-45df-bb78-1487984a06f1 req-4aba8273-bb1d-4677-a7e5-211381b25177 service nova] Creating event network-vif-deleted:1f2d9f96-01a7-4c8b-bbbd-79bbb1b0a065 for instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a on hv-cinder-83588 May 12 15:38:54.183047 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-e06e52e5-df8c-45df-bb78-1487984a06f1 req-4aba8273-bb1d-4677-a7e5-211381b25177 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033506 May 12 15:38:54.183738 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 113/208] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:38:54.188974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:54.189648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:54.195962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.196542 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.197420 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.197914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.336888 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:54.345561 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-eb82b61d-2fe4-4b42-ab3c-f6d2addd1f4e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1725 microversion: 2.1 time: 0.160516 May 12 15:38:54.346146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 114/209] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:54 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:54.693680 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:38:54.694377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:38:54.701483 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.701926 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.702694 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.703137 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.737016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:38:54.737486 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:38:54.738061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lazy-loading 'fault' on Instance uuid d8b7b2b2-7744-4fed-99f3-df96323e2c1a {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:38:54.782500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd41966b7ce4c6e8301ca16d05a7d63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '800882e33dc54145a74fabd425152e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:38:54.789236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3813be02-075f-403d-9285-724bbd2799ab tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 200 len: 1305 microversion: 2.1 time: 0.099563 May 12 15:38:54.790019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 115/210] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:38:54 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:38:54.956459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-802894176", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "networks": [{"uuid": "20f09d87-b555-4743-9833-43160a6cce18"}]}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:06.828351 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] validate_networks() for [('144446a1-8b69-4758-9c58-572c887f90d4', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:39:06.833643 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] validate_networks() for [('20f09d87-b555-4743-9833-43160a6cce18', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:39:07.406675 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:39:07.407224 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:39:07.407975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:39:07.408434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:39:07.409109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:39:07.417936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:39:07.418597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.419203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:39:07.419405 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.420227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.420532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:39:07.420653 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:39:07.420767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.421393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:39:07.439173 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Getting quotas for project 24ad1bfe4f634a188dd1613c630f0bbd. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:07.439734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.440192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.441063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.441627 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.444344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Getting quotas for user 1867e3f3c9ad42de8fa552c1c39f0fcd and project 24ad1bfe4f634a188dd1613c630f0bbd. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:07.456465 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:39:07.458903 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:39:07.460915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Getting quotas for project 15ed6d55b50c4f23bbd4df6b850e9466. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:07.472050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Getting quotas for user 5e0cb7f175f3423384aedd412a653168 and project 15ed6d55b50c4f23bbd4df6b850e9466. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:07.483306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:39:07.485640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:39:07.508976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-51b0f0d9-87e0-486b-a474-6367bbee3cba tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.620628 May 12 15:39:07.508976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 96/211] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:38:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 15622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:39:07.511820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:07.512555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:07.519302 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.519861 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.520800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.521502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.533658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-48e04cbc-1d50-4b55-b829-396e301ebd46 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.581455 May 12 15:39:07.539491 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 116/212] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 12583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:39:07.539491 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:07.539805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:07.546455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.546915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.547757 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.548389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.757880 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:07.760858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:07.767518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8baa36da-4fee-40f4-b291-fe8a68459bb2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.260008 May 12 15:39:07.768236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 97/213] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:07 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:07.770403 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-65809056-8db6-491c-bd01-961ff635651d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1725 microversion: 2.1 time: 0.234890 May 12 15:39:07.772613 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 117/214] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:07 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:07.773788 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:07.774541 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] [instance: d8b7b2b2-7744-4fed-99f3-df96323e2c1a] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:07.780823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:07.781483 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:07.785220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.787905 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.788236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.788824 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.789626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.790062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.790188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:07.790642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:07.812612 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] HTTP exception thrown: Instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a could not be found. May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Request method failure captured: May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a HTTP/1.1 May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSn1MY2CDEVWZr4vzS6O2nhoXNkw_2jS2h6KLYulheJ8g9m7aSRjUPK9LJCGWD3h-XHW1H5qOQLRV9zo5lsAyDkVFOWjGq-z7swEGobpCPGMsjwPiypxqycgp_ZZ6GwgnbKPQ8LSGTV4LivqFY-sIjkWl7mNJhE78pZGWf1OPgSzaas May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 800882e33dc54145a74fabd425152e03 May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-VolumesNegativeTest-728475215 May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:39:07.814657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_800882e33dc54145a74fabd425152e03", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/800882e33dc54145a74fabd425152e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/800882e33dc54145a74fabd425152e03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/800882e33dc54145a74fabd425152e03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-VolumesNegativeTest-728475215 May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 800882e33dc54145a74fabd425152e03 May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-VolumesNegativeTest-728475215 May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-VolumesNegativeTest-728475215-project May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: 8cd41966b7ce4c6e8301ca16d05a7d63 May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-VolumesNegativeTest-728475215-project May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a could not be found. May 12 15:39:07.816036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'd8b7b2b2-7744-4fed-99f3-df96323e2c1a'} May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a could not be found. May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:39:07.817627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a could not be found. May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a could not be found. May 12 15:39:07.818831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:07.820017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a668015e-3f1c-4f12-96cb-c97250747774 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/ips" status: 200 len: 149 microversion: 2.20 time: 0.042542 May 12 15:39:07.820098 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] Returning 404 to user: Instance d8b7b2b2-7744-4fed-99f3-df96323e2c1a could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:39:07.820179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 118/215] 10.222.0.89 () {60 vars in 1288 bytes} [Thu May 12 15:39:07 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:39:07.820253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e633d394-6df3-41a8-acf0-de68ec5c280b tempest-VolumesNegativeTest-728475215 tempest-VolumesNegativeTest-728475215-project] 10.222.0.89 "GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a" status: 404 len: 111 microversion: 2.1 time: 0.046508 May 12 15:39:07.820253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 98/216] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:07 2022] GET /compute/v2.1/servers/d8b7b2b2-7744-4fed-99f3-df96323e2c1a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:39:07.825824 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f3a9a184-e7a3-4368-acd8-6f124fe46834 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:07.827197 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f3a9a184-e7a3-4368-acd8-6f124fe46834 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:07.841061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1850ab05-4673-451d-b1e1-4e32da133d5e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:07.843246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1850ab05-4673-451d-b1e1-4e32da133d5e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:07.884588 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f3a9a184-e7a3-4368-acd8-6f124fe46834 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:07.915183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f3a9a184-e7a3-4368-acd8-6f124fe46834 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1218 microversion: 2.1 time: 0.098660 May 12 15:39:07.916887 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 119/217] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:07 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:08.000118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1850ab05-4673-451d-b1e1-4e32da133d5e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:08.007421 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1850ab05-4673-451d-b1e1-4e32da133d5e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1213 microversion: 2.1 time: 0.189348 May 12 15:39:08.014191 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 99/218] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:07 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:08.786292 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:08.786940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:08.788560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:08.789123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:08.795659 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:08.796085 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:08.796796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:08.796967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:08.797233 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:08.797344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:08.798010 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:08.798442 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:08.998108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:09.000444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:09.007047 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5bdc9e97-5634-4bd7-8631-704b2ec82bfa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1523 microversion: 2.1 time: 0.225791 May 12 15:39:09.007705 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 120/219] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:08 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:09.008580 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-17844ed9-bc20-4ac7-91fa-6f154ccebfd3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1725 microversion: 2.1 time: 0.225443 May 12 15:39:09.013634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 100/220] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:08 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:09.014017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:09.014660 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:09.026737 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:09.027201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:09.027987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:09.028422 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:09.030574 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:09.031192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:09.039797 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:09.040254 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:09.041125 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:09.041560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:09.106867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:09.115119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7fa390cb-512c-42c5-a8a5-2b341fb03e6f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1270 microversion: 2.1 time: 0.106178 May 12 15:39:09.115743 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 121/221] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:09 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:09.128362 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:09.135974 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9922c6f1-3514-41ec-9c13-39d8b942c389 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1265 microversion: 2.1 time: 0.109097 May 12 15:39:09.136689 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 101/222] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:09 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:10.026590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:10.027210 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:10.036820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:10.037570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:10.038353 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.039086 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.040087 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.040634 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.046258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.047848 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.049190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.053278 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.502597 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:10.518946 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d1b29291-756d-410c-9f02-ae1456291d0e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1503 microversion: 2.1 time: 0.495953 May 12 15:39:10.521668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 122/223] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:10 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1503 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:10.534616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:10.544010 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a7d43efe-6afc-4f56-94fb-21b7a0da3064 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1725 microversion: 2.1 time: 0.514739 May 12 15:39:10.544954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 102/224] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:10 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1725 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:10.559409 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:10.560387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:10.562091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:10.566735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:10.569598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.571132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.572326 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.574448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.585577 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.586287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.587687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.588333 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.618364 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lazy-loading 'flavor' on Instance uuid 0a406a83-d33b-40db-adb0-9789902c45cb {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:39:10.669170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:10.676969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-42b9e0f5-db90-428f-a0a2-9762e961f767 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1276 microversion: 2.1 time: 0.130725 May 12 15:39:10.678420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 103/225] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:10 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:10.683472 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:10.684280 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:10.691645 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.692097 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.692967 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.694423 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.811141 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:10.819780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1b023f46-958d-4131-9760-46ba228ca2cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1273 microversion: 2.1 time: 0.139981 May 12 15:39:10.821564 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 104/226] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:10 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:10.847082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:10.847985 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:10.859297 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.859937 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:10.860982 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:10.861629 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.048263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c808be0e-b276-4f9c-b33d-01ee6789b286 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/action" status: 202 len: 0 microversion: 2.20 time: 0.524834 May 12 15:39:11.050395 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 123/227] 10.222.0.89 () {62 vars in 1318 bytes} [Thu May 12 15:39:10 2022] POST /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 15:39:11.060005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:11.066257 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:11.073888 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.074372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.075289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.075997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.269535 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:11.277440 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f0e7c16e-ef31-4d75-bcbb-1c7571cf2fbe tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1515 microversion: 2.1 time: 0.454652 May 12 15:39:11.289560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 105/228] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:10 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:11.357877 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:11.375493 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:11.378393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:11.380422 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1de534de-298e-4ca9-9d82-4269dc452937 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.324934 May 12 15:39:11.381814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 124/229] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:11 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:11.563407 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:11.565253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:11.573741 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.574475 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.590846 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.590846 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.695624 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:11.696388 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:11.707620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.708426 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.709830 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.711373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.826783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:11.839080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f910d896-044b-41f8-93f4-4387ad6a528b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1702 microversion: 2.1 time: 0.280155 May 12 15:39:11.850654 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 106/230] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:11 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1702 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:11.856122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:11.856742 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:11.863817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.864522 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.865560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:11.866249 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:11.987729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:11.998405 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b3214d19-a3a1-423b-8808-76ad843d6091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.306829 May 12 15:39:12.008170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 125/231] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:11 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:12.008170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7ca683d1-dbf6-4d78-8df7-3a513da7e1fc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:12.012828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7ca683d1-dbf6-4d78-8df7-3a513da7e1fc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.013553 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7ca683d1-dbf6-4d78-8df7-3a513da7e1fc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.038745 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7ca683d1-dbf6-4d78-8df7-3a513da7e1fc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Going to try to start instance {{(pid=123632) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 15:39:12.104125 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7ca683d1-dbf6-4d78-8df7-3a513da7e1fc tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action" status: 202 len: 0 microversion: 2.1 time: 0.103478 May 12 15:39:12.105106 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 126/232] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:39:11 2022] POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:39:12.113864 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:12.115391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:12.123620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.124062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.125128 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.125555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.130577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:12.140105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f489f5bd-1f2b-4be1-929b-8bedc8a0a295 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.287682 May 12 15:39:12.141109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 107/233] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:11 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:12.234263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-53ef39f6-d1bd-4b1d-89fa-7cca5b7660ab req-e37bffdb-f786-4489-94a3-dc8e67284698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af588d39-4bcd-46c2-85fa-1c742b2daf8b", "tag": "b4989380-2070-444e-9bc2-b81db642016c"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:12.263336 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-53ef39f6-d1bd-4b1d-89fa-7cca5b7660ab req-e37bffdb-f786-4489-94a3-dc8e67284698 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.264101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-53ef39f6-d1bd-4b1d-89fa-7cca5b7660ab req-e37bffdb-f786-4489-94a3-dc8e67284698 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.291137 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-53ef39f6-d1bd-4b1d-89fa-7cca5b7660ab req-e37bffdb-f786-4489-94a3-dc8e67284698 service nova] Creating event network-changed:b4989380-2070-444e-9bc2-b81db642016c for instance af588d39-4bcd-46c2-85fa-1c742b2daf8b on hv-cinder-83588 May 12 15:39:12.307260 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-53ef39f6-d1bd-4b1d-89fa-7cca5b7660ab req-e37bffdb-f786-4489-94a3-dc8e67284698 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076727 May 12 15:39:12.308296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 108/234] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:12.397418 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:12.401250 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:12.402466 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:12.409663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4ee69faa-e209-4c3f-8eb7-3ec3aba6e437 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1711 microversion: 2.1 time: 0.297789 May 12 15:39:12.411502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.412541 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.413663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.414057 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 127/235] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:12 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1711 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:12.414634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.650642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:12.662608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:12.665128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:12.666738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2dad7f10-d449-486a-877b-e6f2589b2ff0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.271024 May 12 15:39:12.676284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 109/236] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:12 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:12.710528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:12.712499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:12.718753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.719757 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.720876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.721532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.747768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lazy-loading 'flavor' on Instance uuid f2f2fa5c-7d16-4c2e-978e-c63f357f460f {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:39:12.838241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-24b4f61d-3fd8-40b9-ae67-34cbb5842d03 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/action" status: 200 len: 32 microversion: 2.1 time: 0.132122 May 12 15:39:12.838985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 128/237] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:39:12 2022] POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:39:12.847929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:12.848556 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:12.855137 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.855933 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:12.856711 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:12.857138 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.016140 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:13.017066 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:13.024170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.024960 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.025930 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.026577 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.320680 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.328040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-76084004-69cf-4f2d-82f4-b55b01bb81f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.483873 May 12 15:39:13.329153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 110/238] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:12 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:13.334357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:13.334918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:13.341500 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.342105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.342868 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.343515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.404376 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.411832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2f736191-efe7-4dce-b987-130f87243091 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.399966 May 12 15:39:13.412404 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 129/239] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:13 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:13.430326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:13.430901 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:13.437305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.437876 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.438766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.439208 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.625778 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.634078 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-bdaf6ee2-4ae8-4a2f-a9ab-cc6a625d36cd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.303112 May 12 15:39:13.635117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 111/240] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:13 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:13.640059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-5338576f-bcdb-4eca-8ddb-eb47067889e3 req-578940c8-9008-47f2-9a9a-eff18f11425e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b820554-1bdf-417a-905f-d5ee27426a3d", "tag": "d4c34e01-3258-4bbf-80f0-93fbf3bc4af8"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:13.648845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-5338576f-bcdb-4eca-8ddb-eb47067889e3 req-578940c8-9008-47f2-9a9a-eff18f11425e service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.649372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-5338576f-bcdb-4eca-8ddb-eb47067889e3 req-578940c8-9008-47f2-9a9a-eff18f11425e service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.662071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-5338576f-bcdb-4eca-8ddb-eb47067889e3 req-578940c8-9008-47f2-9a9a-eff18f11425e service nova] Creating event network-changed:d4c34e01-3258-4bbf-80f0-93fbf3bc4af8 for instance 4b820554-1bdf-417a-905f-d5ee27426a3d on hv-cinder-83588 May 12 15:39:13.667393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-5338576f-bcdb-4eca-8ddb-eb47067889e3 req-578940c8-9008-47f2-9a9a-eff18f11425e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030772 May 12 15:39:13.667594 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.668495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 112/241] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:13.677354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8d5c00a6-68fd-4826-8f0d-313343f20913 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1711 microversion: 2.1 time: 0.250965 May 12 15:39:13.684690 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 130/242] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:13 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1711 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:13.686706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:13.687426 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:13.694174 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.694714 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.695510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:13.695954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:13.831467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.839744 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.841173 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:13.842325 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a0bcc41f-0fe1-4d0b-8c0e-b2e59f66524b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.160091 May 12 15:39:13.842914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 113/243] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:13 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:14.345541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:14.346137 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:14.353416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.354100 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.355024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.355609 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.428681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:14.429737 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:14.438535 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.449704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.451101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.452771 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.630988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:14.638784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-073b4e24-a547-4673-be16-c8c58bf1c1fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.297030 May 12 15:39:14.639402 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 131/244] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:14 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:14.652683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:14.653496 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:14.658642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:14.660455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.661088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.661945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.662399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.667402 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d101b9a4-6a5c-4c70-8103-c185e80ca319 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.243404 May 12 15:39:14.668083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 114/245] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:14 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:14.695615 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:14.696126 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:14.702676 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.703120 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:14.703891 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:14.704357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.055895 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.064218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-21a88096-2ee7-4c93-b0cc-012e6a3bc7e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.416708 May 12 15:39:15.064916 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 132/246] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:14 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:15.069434 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:15.070125 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:15.080633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:15.081088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.081937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:15.082369 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.082832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.091987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-54e372b2-0c6e-46c5-8257-f000b7898c6c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1711 microversion: 2.1 time: 0.400251 May 12 15:39:15.092738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 115/247] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:14 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1711 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:15.620764 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.632838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.634592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.635965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d8881e11-036f-4b1c-982c-8b183bd85040 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.570159 May 12 15:39:15.636978 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 133/248] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:15 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:15.656934 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:15.658840 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:15.666544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:15.667367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.669363 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:15.670054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.688321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:15.689225 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:15.697188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:15.697916 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.698904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:15.699520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:15.909511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.913241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:15.917495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6dad43af-b66e-49a7-8e87-0867d8f35f11 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.264824 May 12 15:39:15.918080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 116/249] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:15 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:15.922188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-36eeb380-5dde-4d90-b87d-d25aa1df57ac tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.237723 May 12 15:39:15.923248 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 134/250] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:15 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:15.929325 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1462692682", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546602223", "security_groups": [{"name": "tempest-secgroup-smoke-1255422790"}], "block_device_mapping_v2": [{"uuid": "5ce534b9-482e-427c-a2d3-4b69380a7a7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "869afb1f-8f08-43d2-8b78-38d5d6f40548"}]}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:16.040319 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] validate_networks() for [('869afb1f-8f08-43d2-8b78-38d5d6f40548', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:39:16.081579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:16.082500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:16.090265 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.091291 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.092585 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.093208 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.279158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:16.286772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-952f7bf6-96f1-4479-924f-4ae7e454ef4d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.209447 May 12 15:39:16.287372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 135/251] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:16 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:16.291729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:16.292534 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:16.298724 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.299184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.299962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.300403 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.513648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:16.524174 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-98941eae-671e-4394-aedf-d73cdd2d1dbd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1715 microversion: 2.1 time: 0.235778 May 12 15:39:16.535480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 136/252] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:16 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1715 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:16.539441 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:39:16.540082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:39:16.540583 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:39:16.541138 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:39:16.541611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:39:16.551514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.551959 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.552814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.553247 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.571844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for project 4b8824725a894bbcb17789008292c1e4. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:16.576357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for user 73bfb098d5f04da9adb7ae1d30fd30b1 and project 4b8824725a894bbcb17789008292c1e4. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:16.642141 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:39:16.644246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ce534b9-482e-427c-a2d3-4b69380a7a7f',volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:39:16.655457 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:16.656048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:16.667576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.667936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.669209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.669639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.790132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-54bd2eb5-9e88-453b-9782-51a5f7e4bdb9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.870322 May 12 15:39:16.791743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 117/253] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:39:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:39:16.802015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-896ca8de-929c-40f7-92e6-f84d794e7f91 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:16.802711 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-896ca8de-929c-40f7-92e6-f84d794e7f91 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:16.813676 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:16.823531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:16.825054 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:16.826441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9c9e58a5-8ecf-42ab-baf6-872cf9ba5351 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.175021 May 12 15:39:16.827192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 137/254] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:16 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:16.859467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-896ca8de-929c-40f7-92e6-f84d794e7f91 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:16.866560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-896ca8de-929c-40f7-92e6-f84d794e7f91 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1095 microversion: 2.1 time: 0.068252 May 12 15:39:16.867130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 118/255] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:16 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:16.936862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:16.937585 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:16.940140 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:16.943330 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:16.946108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.946563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.947540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.948176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.950182 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.950621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:16.951438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:16.952324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:17.147498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:17.155530 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-204fb879-a0bc-4431-a164-83e5d91c0563 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.220129 May 12 15:39:17.156508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 119/256] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:16 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:17.166217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:17.174373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-22dfb64c-a75a-45c7-be23-67e972a6a37a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.242806 May 12 15:39:17.174945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 138/257] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:16 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:17.303691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:17.304293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:17.311341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:17.311791 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:17.312593 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:17.313063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:17.446843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:17.454432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d47543c8-5c0e-4cf5-a7c8-e964e5c682fa tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.154674 May 12 15:39:17.454996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 120/258] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:17 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:17.845412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:17.846016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:17.853128 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:17.853789 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:17.854947 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:17.855373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:17.885072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:17.886330 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:17.918300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:17.925092 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:17.926205 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:17.926856 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.062414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.073541 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.077122 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.078829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-17d6a6a4-72cd-4abb-aa73-9c25b902544a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.237201 May 12 15:39:18.079918 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 139/259] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:17 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:18.087371 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.097736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-49f0a80c-49eb-422b-bbb3-8aaa5772329a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1211 microversion: 2.1 time: 0.216170 May 12 15:39:18.098449 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 121/260] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:17 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1211 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:18.173874 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:18.174484 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:18.181334 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.182070 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.183051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.183480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.191661 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:18.192361 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:18.199189 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.199837 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.200834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.201425 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.381367 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.390520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d7846f7d-9d66-4929-917c-7e22b11f6558 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.220506 May 12 15:39:18.391329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 140/261] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:18 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:18.395821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-4c267274-7ed5-4f81-8212-41be052e3e1b req-283bca4d-288b-4dc2-8efc-c0ee7fd50613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af588d39-4bcd-46c2-85fa-1c742b2daf8b", "name": "network-vif-plugged", "status": "completed", "tag": "b4989380-2070-444e-9bc2-b81db642016c"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:18.404634 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4c267274-7ed5-4f81-8212-41be052e3e1b req-283bca4d-288b-4dc2-8efc-c0ee7fd50613 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.405567 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4c267274-7ed5-4f81-8212-41be052e3e1b req-283bca4d-288b-4dc2-8efc-c0ee7fd50613 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.413225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.422828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1a78fc0e-f78b-4d9a-a4aa-947c8593cfda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.235201 May 12 15:39:18.423418 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 122/262] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:18 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:18.430025 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-4c267274-7ed5-4f81-8212-41be052e3e1b req-283bca4d-288b-4dc2-8efc-c0ee7fd50613 service nova] Creating event network-vif-plugged:b4989380-2070-444e-9bc2-b81db642016c for instance af588d39-4bcd-46c2-85fa-1c742b2daf8b on hv-cinder-83588 May 12 15:39:18.435490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-4c267274-7ed5-4f81-8212-41be052e3e1b req-283bca4d-288b-4dc2-8efc-c0ee7fd50613 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042880 May 12 15:39:18.436077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 141/263] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:18.471877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:18.472401 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:18.481024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.482275 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.483226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:18.483815 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:18.658165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:18.665882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-884c29ee-9539-43e3-ab5e-de309fa2a321 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.198389 May 12 15:39:18.675508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 123/264] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:18 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:19.099041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:19.099718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:19.106794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.107523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.108462 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.110578 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.117263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:19.118143 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:19.124798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.125783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.126845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.127541 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.311794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.320833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.322591 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.324010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f18718ed-f3f9-42ab-b02a-0c93e1da592e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.229838 May 12 15:39:19.324794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 142/265] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:19 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:39:19.408558 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:19.409302 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:19.419895 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.421808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.422970 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.423555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.428367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.437926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8f9df127-49f1-46a7-92aa-1db1ef7a007e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.326305 May 12 15:39:19.448494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 124/266] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:19 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:19.453490 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-b52ac4f5-6461-4e84-995a-fde1c6e7ddd7 req-627ac974-6cc7-4794-8a56-0efc33a8ef1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc5f8be-b344-46fd-bae9-266847ebfdc1", "tag": "f92017be-34f1-4663-8133-b097ab792782"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:19.462925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-b52ac4f5-6461-4e84-995a-fde1c6e7ddd7 req-627ac974-6cc7-4794-8a56-0efc33a8ef1c service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.463480 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-b52ac4f5-6461-4e84-995a-fde1c6e7ddd7 req-627ac974-6cc7-4794-8a56-0efc33a8ef1c service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.479907 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-b52ac4f5-6461-4e84-995a-fde1c6e7ddd7 req-627ac974-6cc7-4794-8a56-0efc33a8ef1c service nova] Creating event network-changed:f92017be-34f1-4663-8133-b097ab792782 for instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 on hv-cinder-83588 May 12 15:39:19.485271 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-b52ac4f5-6461-4e84-995a-fde1c6e7ddd7 req-627ac974-6cc7-4794-8a56-0efc33a8ef1c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 May 12 15:39:19.489828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 125/267] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:19.495911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:19.497029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:19.507375 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.512221 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.513684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.514299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.709854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.717544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-33c92d06-bcba-483b-9709-af03b215f37a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1318 microversion: 2.1 time: 0.314111 May 12 15:39:19.725965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 143/268] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:19 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:19.725965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:19.725965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:19.729746 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.730190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.730962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:19.731388 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:19.758472 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.767548 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-179f6e4c-58e3-4b8f-887b-76ad9d8dcc60 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.275655 May 12 15:39:19.768148 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 126/269] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:19 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:19.901428 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:19.909732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-406f1c2b-3fa8-497f-be7e-d73331977b3f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.190374 May 12 15:39:19.910414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 144/270] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:19 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:20.343102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:20.343710 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:20.350409 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.350934 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.351708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.352365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.455284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:20.456493 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:20.465002 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.465722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.466641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.467077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.510001 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:20.518412 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:20.519904 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:20.521089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-85d01ba3-530f-4060-9595-790d72e4a40d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.181970 May 12 15:39:20.522219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 127/271] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:20 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:20.634724 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:20.642435 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-284b8d97-a09a-433c-95ca-38c9073e6a59 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.191056 May 12 15:39:20.648970 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 145/272] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:20 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:20.734206 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:20.735018 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:20.741366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.741832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.742598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.743036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.784590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:20.785225 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:20.794124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.794569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.795435 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.795870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.915637 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:20.925824 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d2a1b181-0b20-46c4-996f-fff2c993a6de tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1506 microversion: 2.1 time: 0.195448 May 12 15:39:20.946794 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 128/273] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:20 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:20.955487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:20.956544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:20.970646 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.974393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.975227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:20.975704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:20.994579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:21.003053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c3059ace-dd0b-4a90-8574-a61de4dad16b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.222877 May 12 15:39:21.004863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 146/274] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:20 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:21.132033 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:21.141411 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-064e2abe-df32-4740-a314-e692c64164d7 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.191919 May 12 15:39:21.142617 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 129/275] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:20 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:21.539538 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:21.540148 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:21.547586 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:21.548273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:21.549332 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:21.550204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:21.661121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:21.661789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:21.669171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:21.670283 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:21.671258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:21.671883 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:21.688878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:21.699199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:21.700975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:21.702423 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-226c75b2-b957-4493-b41f-b073ba5e7b8a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.166971 May 12 15:39:21.713049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 147/276] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:21 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:21.819082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:21.826537 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d4f677ab-2035-4d90-9829-f37007a36b98 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.171320 May 12 15:39:21.827103 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 130/277] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:21 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:22.020041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:22.020684 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:22.030560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.031220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.032093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.033103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.158238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:22.159031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:22.167574 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.168045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.169207 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.169806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.182599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:22.190783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ea03d5cf-f13a-43aa-95ab-2b48623a1204 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.174459 May 12 15:39:22.191563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 148/278] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:22 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:22.204058 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-c9307250-e508-4c9e-bef8-5d73cd8dbe31 req-8d9a1d85-d7c5-4854-a06b-249ada84c48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b820554-1bdf-417a-905f-d5ee27426a3d", "name": "network-vif-plugged", "status": "completed", "tag": "d4c34e01-3258-4bbf-80f0-93fbf3bc4af8"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:22.213431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-c9307250-e508-4c9e-bef8-5d73cd8dbe31 req-8d9a1d85-d7c5-4854-a06b-249ada84c48b service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.214714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-c9307250-e508-4c9e-bef8-5d73cd8dbe31 req-8d9a1d85-d7c5-4854-a06b-249ada84c48b service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.234221 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-c9307250-e508-4c9e-bef8-5d73cd8dbe31 req-8d9a1d85-d7c5-4854-a06b-249ada84c48b service nova] Creating event network-vif-plugged:d4c34e01-3258-4bbf-80f0-93fbf3bc4af8 for instance 4b820554-1bdf-417a-905f-d5ee27426a3d on hv-cinder-83588 May 12 15:39:22.241332 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-c9307250-e508-4c9e-bef8-5d73cd8dbe31 req-8d9a1d85-d7c5-4854-a06b-249ada84c48b service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048204 May 12 15:39:22.243606 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 149/279] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:22.329095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:22.336564 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ca191913-9c63-4681-acb7-241f1c0b4511 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.182079 May 12 15:39:22.337139 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 131/280] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:22 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:22.722194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:22.722758 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:22.729454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.729903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.730659 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.731089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.843324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:22.843942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:22.850936 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.851309 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.852133 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:22.852595 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:22.864838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:22.872815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:22.874330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:22.875482 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e8c81bdd-59e3-440c-963e-6fd31f9b2067 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.158253 May 12 15:39:22.876237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 150/281] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:22 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:22.993173 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:23.000761 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d12f9f6b-613e-4c47-b3d6-3c75a9c6412e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.161365 May 12 15:39:23.001336 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 132/282] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:22 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:23.211314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:23.211922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:23.218631 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:23.219088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:23.219862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:23.220301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:23.353635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:23.354437 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:23.361040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:23.361288 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:23.362057 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:23.362492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:23.362954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:23.371025 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3b0b4d0f-b65f-42b0-a5e3-7c0204f3361d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.165855 May 12 15:39:23.371576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 151/283] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:23 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:23.494529 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:23.501954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1e8e8a07-763f-4679-afce-531acbc529d6 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1313 microversion: 2.1 time: 0.152219 May 12 15:39:23.502518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 133/284] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:23 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:23.894463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:23.894997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:23.901722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:23.902175 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:23.902951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:23.903392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.017901 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:24.018524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:24.026014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:24.026582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.027454 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:24.027959 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.047176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:24.056862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:24.058629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:24.060153 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2403ff4b-6f48-4611-ab40-30a82789948e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.169636 May 12 15:39:24.060903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 152/285] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:23 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:24.167949 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:24.176170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9aa99f52-e772-4b8f-935e-ccb5d349d647 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.162166 May 12 15:39:24.176832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 134/286] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:24 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:24.391296 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:24.392300 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:24.401779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:24.402236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.402999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:24.403441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.518961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:24.519405 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:24.535581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:24.536146 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.537031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:24.537477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:24.553034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:24.560580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-92a187e2-fb53-4a79-9e6e-064cb05d83e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.175719 May 12 15:39:24.561157 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 153/287] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:24 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:24.674300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:24.681964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8640749b-9b61-476f-ac38-d2323e262ed4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1496 microversion: 2.1 time: 0.167095 May 12 15:39:24.682569 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 135/288] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:24 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:25.082739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:25.083663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:25.092460 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:25.092938 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:25.093711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:25.094144 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:25.193287 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:25.193864 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:25.200878 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:25.201323 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:25.202096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:25.202524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:25.227337 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:25.235778 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:25.237251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:25.238424 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c936a180-5fe2-4a8a-a3b3-62e81201ecaf tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.162191 May 12 15:39:25.239005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 154/289] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:25 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:25.344494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:25.352063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e2541a8b-7673-473a-a656-74a80ac1f2d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.162644 May 12 15:39:25.352650 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 136/290] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:25 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:25.577896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:25.578600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:25.584940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:25.585395 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:25.586176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:25.586643 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:25.715825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:25.723403 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-84537f0c-db9a-4424-88c4-1f56446e8c66 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.149330 May 12 15:39:25.723948 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 155/291] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:25 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:26.261285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:26.262250 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:26.273181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:26.273941 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:26.275212 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:26.275925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:26.370773 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:26.372096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:26.378945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:26.379389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:26.380188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:26.380654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:26.412694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:26.421188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:26.422720 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:26.423929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2d9393ed-a068-48cd-8f73-83e0b8d73dca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.169250 May 12 15:39:26.424486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 137/292] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:26 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:26.506357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:26.514792 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ffe47003-8de5-4574-a9b8-3cac2414b897 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.147819 May 12 15:39:26.515263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 156/293] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:26 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:26.748804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:26.749800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:26.760187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:26.761023 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:26.761797 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:26.762229 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:26.896734 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:26.907145 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e3ba9b8b-e87b-4715-af6f-f8bdcee55431 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.164846 May 12 15:39:26.907754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 138/294] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:26 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:27.442502 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:27.443073 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:27.450176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.450658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.451385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.451797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.484967 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:27.485520 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:27.494588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.494588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.494588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.494588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.523467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:39:27.582616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:27.590745 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:27.592275 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:27.593464 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3a473c03-3249-4ee6-adea-985d157aa589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.155032 May 12 15:39:27.594027 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 157/295] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:27 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:27.598965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:27.599889 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:27.603613 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2e334ef7-e64d-48cf-b1a0-6c3d979193e8 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "DELETE /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 204 len: 0 microversion: 2.1 time: 0.123105 May 12 15:39:27.604640 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 139/296] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:39:27 2022] DELETE /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:39:27.609451 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.609911 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.610706 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.611351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.613316 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:27.613994 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:27.620268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.620787 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.621574 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.622657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.801630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:27.809378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f650d50d-416f-4adc-a95a-d961e24c1943 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.214177 May 12 15:39:27.809952 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 158/297] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:27 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:27.824827 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:27.832285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3e16ee75-b1fd-4b3c-891e-261024e91f20 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.223538 May 12 15:39:27.832845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 140/298] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:27 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:27.926891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:27.927732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:27.935812 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.936202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:27.937131 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:27.937653 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.073601 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:28.084495 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-49eed303-08df-4f23-9b2f-f557d01e81d6 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.162804 May 12 15:39:28.085442 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 159/299] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:27 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:28.252851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-5f807833-482f-4d58-bb28-64e97798408f req-92fd06bf-a84e-4e4a-9386-9a2962f6dedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "name": "network-vif-plugged", "status": "completed", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:28.261410 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-5f807833-482f-4d58-bb28-64e97798408f req-92fd06bf-a84e-4e4a-9386-9a2962f6dedb service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.261716 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-5f807833-482f-4d58-bb28-64e97798408f req-92fd06bf-a84e-4e4a-9386-9a2962f6dedb service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.272986 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-5f807833-482f-4d58-bb28-64e97798408f req-92fd06bf-a84e-4e4a-9386-9a2962f6dedb service nova] Creating event network-vif-plugged:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:39:28.277876 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-5f807833-482f-4d58-bb28-64e97798408f req-92fd06bf-a84e-4e4a-9386-9a2962f6dedb service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028966 May 12 15:39:28.278473 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 141/300] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:28.617074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:28.618121 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:28.626260 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.626711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.627477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.627904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.767997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:28.776405 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:28.778002 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:28.779168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cfcfee65-18b4-483e-a72e-2f0e480d69dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.168778 May 12 15:39:28.779732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 160/301] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:28 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:28.827529 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:28.828187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:28.834490 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.834937 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.835704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.836149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.849059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:28.849678 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:28.859553 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.860020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:28.860865 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:28.861302 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:29.027680 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:29.035806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8326ad46-697b-487b-bbe6-dcea8d5a3817 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.213212 May 12 15:39:29.036427 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 142/302] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:28 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:29.039908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:29.048433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-193bdfa1-59e5-4af0-b63f-198a3e0b03e1 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.203365 May 12 15:39:29.049023 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 161/303] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:28 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:29.102045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:29.102566 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:29.109257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:29.109712 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:29.110482 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:29.110921 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:29.246955 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:29.255963 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-865c36c7-5a9e-4b75-a7b1-436e3928ada2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.157815 May 12 15:39:29.256763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 143/304] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:29 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:29.799281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:29.799955 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:29.806835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:29.807414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:29.808256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:29.808797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:29.942634 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:29.951324 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:29.952860 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:29.954025 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-159a0781-9ed4-49ae-98b8-2cc2586ee53d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.158736 May 12 15:39:29.954597 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 162/305] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:29 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:30.057405 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:30.057953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:30.065103 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.065547 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.065686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:30.066166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:30.066323 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.066718 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.072500 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.072989 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.073760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.074195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.259515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:30.262603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:30.267400 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1dd44bf7-d954-4dbe-9083-459522ad8e50 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.216516 May 12 15:39:30.268461 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 144/306] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:30 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:30.270929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3696a9e5-0042-4aea-a50e-a73b890db447 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.209169 May 12 15:39:30.271642 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 163/307] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:30 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:30.273255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:30.273853 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:30.280208 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.280706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.281473 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.281907 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.417248 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:30.425696 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1584ef07-1e05-4757-a857-3c2829876ff1 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.156063 May 12 15:39:30.426280 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 145/308] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:30 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:30.971916 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:30.972557 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:30.979572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.980028 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:30.980863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:30.981294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.121256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:31.129709 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:31.131216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:31.132369 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0e0855a7-0c81-4706-8200-4476a396f16a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1741 microversion: 2.20 time: 0.164454 May 12 15:39:31.132964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 164/309] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:30 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:31.288978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:31.289995 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:31.291148 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:31.292155 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:31.298445 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:31.298957 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.299563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:31.299705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:31.300045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.300214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.300842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:31.301270 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.489749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:31.494057 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:31.497739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a2268af6-ea15-45de-9d66-7b871ddb2c14 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.213232 May 12 15:39:31.498510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 165/310] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:31 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:31.501762 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-60d98a19-205d-4f06-bf3c-030b55a8ef6f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.219387 May 12 15:39:31.502452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 146/311] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:31 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:31.502710 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:31.503309 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:31.509230 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:31.509694 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.510466 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:31.510902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:31.639201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:31.647240 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0e2aaff5-44e7-4b47-94ea-67952b0736bb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.147964 May 12 15:39:31.647795 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 166/312] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:31 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:32.151990 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:32.152536 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:32.159915 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.160402 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.161464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.161932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.301003 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:32.309461 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:32.311061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:32.312222 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6ac9d062-2e52-4e64-b1d2-2521d32f8dee tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.164834 May 12 15:39:32.313631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 147/313] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:32 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:32.518106 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:32.519059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:32.522729 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:32.523957 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:32.530015 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.530458 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.531287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.531722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.533951 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.534648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.535551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.535958 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.718479 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:32.726275 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-257bb5f0-dfe2-40cb-afce-b4bb0b110b8a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.214250 May 12 15:39:32.726828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 167/314] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:32 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:32.727295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:32.731234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:32.731840 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:32.735284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-504d5ad4-38b7-4de0-9ae7-b8d483a300e7 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.219714 May 12 15:39:32.736061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 148/315] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:32 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:32.737928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.738410 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.739188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:32.739621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:32.871836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:32.882532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-00f14737-10c4-4221-8325-f9b13c716a38 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.154515 May 12 15:39:32.883314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 168/316] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:32 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:33.334460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:33.335464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:33.345672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.346132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.346929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.347373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.486095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:33.494084 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:33.495583 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:33.496767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-437f790a-7190-4b26-8030-da2e4f6cb672 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.169028 May 12 15:39:33.497337 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 149/317] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:33 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:33.743793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:33.744372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:33.751499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.751980 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.752434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:33.752840 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.753114 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:33.753288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.759741 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.760212 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.761058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.761513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.944020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:33.952354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:33.952562 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6cae4834-3f99-467a-8dee-8fac2ef476e0 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.212715 May 12 15:39:33.953463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 169/318] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:33 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:33.957811 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:33.958399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:33.960739 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-28341acb-0012-412b-8b49-63936468cfcd tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.212226 May 12 15:39:33.961510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 150/319] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:33 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:33.964625 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.965083 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:33.965865 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:33.966302 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:34.102229 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:34.110048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e9ddec19-f837-4471-a163-463d8a4e8717 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.155807 May 12 15:39:34.110633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 170/320] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:33 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:34.515020 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:34.515765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:34.522767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:34.523211 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:34.523970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:34.524398 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:34.655631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:34.665237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:34.666794 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:34.668044 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-32e80c3c-9e3d-46fb-99b8-12e835fba1f7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.156970 May 12 15:39:34.669004 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 151/321] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:34 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:34.970361 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:34.971127 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:34.978561 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:34.978993 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:34.979810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:34.979965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:34.980203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:34.981041 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:34.988295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:34.988887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:34.989775 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:34.990278 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:35.177467 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:35.185417 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-74720c18-6aaa-4421-a863-2fbe95100f90 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.219093 May 12 15:39:35.186311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 171/322] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:34 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:35.190887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:35.197093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:35.197765 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:35.198844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d9500dbb-3b65-43e1-97f6-b07388fbc452 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.225651 May 12 15:39:35.199444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 152/323] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:34 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:35.203951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:35.204506 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:35.205355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:35.205858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:35.339074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:35.346925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-81ec8161-3f84-4e8f-bf91-780ca4b64eda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.159462 May 12 15:39:35.347513 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 172/324] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:35 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:35.691237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:35.691872 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:35.700184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:35.700795 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:35.701746 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:35.702283 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.086703 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:36.095060 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:36.096847 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:36.098203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cc32a7f1-7ef7-469a-8572-45d72d2cd807 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.412952 May 12 15:39:36.100879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 153/325] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:35 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:36.203009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:36.203596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:36.210282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.210702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.211540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.211979 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.215730 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:36.216571 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:36.223109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.223879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.224761 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.225253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.399311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:36.413722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f648399d-a23f-48e8-bd91-e68e2ccb7f30 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1502 microversion: 2.1 time: 0.214444 May 12 15:39:36.416131 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 173/326] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:36 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:36.423752 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:36.424792 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:36.426625 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:36.434723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-930d95f6-654f-430d-8e97-287352c57ac6 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.223063 May 12 15:39:36.435885 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.437076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.438190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.438974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.441963 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 154/327] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:36 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:36.480606 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-01096dc0-5b14-48b7-b41c-24a1c104b985 req-98eedb8c-e3d6-49ac-9ea2-c917f39bce89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b820554-1bdf-417a-905f-d5ee27426a3d", "name": "network-vif-deleted", "tag": "d4c34e01-3258-4bbf-80f0-93fbf3bc4af8"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:36.489257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-01096dc0-5b14-48b7-b41c-24a1c104b985 req-98eedb8c-e3d6-49ac-9ea2-c917f39bce89 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:36.489694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-01096dc0-5b14-48b7-b41c-24a1c104b985 req-98eedb8c-e3d6-49ac-9ea2-c917f39bce89 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:36.503085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-01096dc0-5b14-48b7-b41c-24a1c104b985 req-98eedb8c-e3d6-49ac-9ea2-c917f39bce89 service nova] Creating event network-vif-deleted:d4c34e01-3258-4bbf-80f0-93fbf3bc4af8 for instance 4b820554-1bdf-417a-905f-d5ee27426a3d on hv-cinder-83588 May 12 15:39:36.516321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-01096dc0-5b14-48b7-b41c-24a1c104b985 req-98eedb8c-e3d6-49ac-9ea2-c917f39bce89 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039275 May 12 15:39:36.517607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 155/328] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:39:36.599477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:36.608158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-acaf0ce2-6819-420e-9d01-b9df0578165b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.190520 May 12 15:39:36.614398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 174/329] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:36 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:37.117568 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:37.118336 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:37.124894 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.125339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.126142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.127726 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.273899 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:37.281899 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:37.283546 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:37.284722 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b8756a44-84db-4273-a26f-f3bd72900ea1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.171908 May 12 15:39:37.285264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 156/330] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:37 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:37.434634 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:37.435233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:37.442318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.443178 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.444175 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.444859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.453591 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:37.454451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:37.464945 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.465515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.466315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.466757 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.517809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:37.531769 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-52b6b409-b265-4170-9f40-4ed01dd1dd6f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 200 len: 1298 microversion: 2.1 time: 0.096406 May 12 15:39:37.532899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 175/331] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:37 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:37.624845 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:37.625554 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:37.633769 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.634322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.635209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:37.635817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:37.645392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:37.654094 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c8a933ae-52f0-4fc6-9b2f-4be0802d782d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.206667 May 12 15:39:37.657256 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 157/332] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:37 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:37.775926 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:37.783590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-93ba3e03-63b6-41dd-a4f5-4f8d2b2e3b07 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.162793 May 12 15:39:37.784192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 176/333] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:37 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:38.305818 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:38.307223 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:38.314399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.315246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.316365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.317047 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.550474 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:38.551880 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 4b820554-1bdf-417a-905f-d5ee27426a3d] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:38.561204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.561605 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:38.561749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.562408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.563000 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.575725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:38.577680 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:38.579339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d7717068-18a4-4306-86cc-65c308a9f275 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.278726 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] HTTP exception thrown: Instance 4b820554-1bdf-417a-905f-d5ee27426a3d could not be found. May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Request method failure captured: May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d HTTP/1.1 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSoNAy66ovA9ID72feCQbiUtENEjIYvvWs7Oj9ipsxIok7juMMB6G3RITAoSo7NWevAsGH2Tqy4zhLr9yMAwtOFiudcUzJgaFwdPgXGLAmjCh78wiPEvrx6BUc3v3afSS14lUKJxIjB7F97aEwjFIU2_CJ-FOJdSn6cyx3N5Z0OCNQw May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 15ed6d55b50c4f23bbd4df6b850e9466 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesActionsTest-422514033 May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:39:38.590566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_15ed6d55b50c4f23bbd4df6b850e9466", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/15ed6d55b50c4f23bbd4df6b850e9466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/15ed6d55b50c4f23bbd4df6b850e9466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/15ed6d55b50c4f23bbd4df6b850e9466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesActionsTest-422514033 May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 15ed6d55b50c4f23bbd4df6b850e9466 May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesActionsTest-422514033 May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesActionsTest-422514033-project May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 5e0cb7f175f3423384aedd412a653168 May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesActionsTest-422514033-project May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 4b820554-1bdf-417a-905f-d5ee27426a3d could not be found. May 12 15:39:38.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '4b820554-1bdf-417a-905f-d5ee27426a3d'} May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b820554-1bdf-417a-905f-d5ee27426a3d could not be found. May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:39:38.592850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b820554-1bdf-417a-905f-d5ee27426a3d could not be found. May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b820554-1bdf-417a-905f-d5ee27426a3d could not be found. May 12 15:39:38.594107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:39:38.596704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Returning 404 to user: Instance 4b820554-1bdf-417a-905f-d5ee27426a3d could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:39:38.596704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7514a1c7-00c9-43c8-9bd1-89ff32ef4e45 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d" status: 404 len: 111 microversion: 2.1 time: 0.041260 May 12 15:39:38.596704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 177/334] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:38 2022] GET /compute/v2.1/servers/4b820554-1bdf-417a-905f-d5ee27426a3d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:39:38.596704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-0eaefce6-7ea6-46b3-93cf-9f6c5b8ba83a req-e68563de-15f3-411f-a63f-70c6decd09ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc5f8be-b344-46fd-bae9-266847ebfdc1", "name": "network-vif-plugged", "status": "completed", "tag": "f92017be-34f1-4663-8133-b097ab792782"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:38.597703 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 158/335] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:38 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:39:38.606996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-0eaefce6-7ea6-46b3-93cf-9f6c5b8ba83a req-e68563de-15f3-411f-a63f-70c6decd09ad service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.607517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-0eaefce6-7ea6-46b3-93cf-9f6c5b8ba83a req-e68563de-15f3-411f-a63f-70c6decd09ad service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.621391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-0eaefce6-7ea6-46b3-93cf-9f6c5b8ba83a req-e68563de-15f3-411f-a63f-70c6decd09ad service nova] Creating event network-vif-plugged:f92017be-34f1-4663-8133-b097ab792782 for instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 on hv-cinder-83588 May 12 15:39:38.626684 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-0eaefce6-7ea6-46b3-93cf-9f6c5b8ba83a req-e68563de-15f3-411f-a63f-70c6decd09ad service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 May 12 15:39:38.627786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 178/336] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:38.671969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:38.672636 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:38.680184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.680923 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.682075 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.682682 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.747975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1119813549", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "networks": [{"uuid": "20f09d87-b555-4743-9833-43160a6cce18"}]}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:38.811916 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] validate_networks() for [('20f09d87-b555-4743-9833-43160a6cce18', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:39:38.935491 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:38.949505 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-abebb1fc-d3c4-49b0-8146-23325c4cdb80 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.281871 May 12 15:39:38.950103 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 159/337] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:38 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:38.959866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:38.960787 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:38.967704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.968451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:38.969419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:38.970030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:39.246623 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:39.255429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cc54d348-52cd-4032-89ef-d5b19447ecb8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.304306 May 12 15:39:39.256003 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 160/338] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:38 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:39.347059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:39:39.347600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:39:39.348139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:39:39.348654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:39:39.349295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:39:39.362371 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:39.363010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:39.364337 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:39.365030 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:39.386686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Getting quotas for project 15ed6d55b50c4f23bbd4df6b850e9466. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:39.390857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Getting quotas for user 5e0cb7f175f3423384aedd412a653168 and project 15ed6d55b50c4f23bbd4df6b850e9466. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:39.403083 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:39:39.405480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:39:39.452672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fcd91af3-b499-4021-a90a-9847a82c5329 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709911 May 12 15:39:39.458811 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 179/339] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:39:39.463599 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-98cccd77-4bc3-4a45-94e1-4b04fd0ca1db tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:39.464201 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-98cccd77-4bc3-4a45-94e1-4b04fd0ca1db tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:39.541210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-98cccd77-4bc3-4a45-94e1-4b04fd0ca1db tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:39.556772 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-98cccd77-4bc3-4a45-94e1-4b04fd0ca1db tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1214 microversion: 2.1 time: 0.096630 May 12 15:39:39.567822 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 161/340] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:39 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:39.601574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:39.602197 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:39.626654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:39.635094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:39.636357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:39.637006 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:39.785478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:39.794227 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:39.795730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:39.796986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4a4fef51-0bf5-4ca8-bdde-a64f4104fe7d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.202743 May 12 15:39:39.797563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 180/341] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:39 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:39.968253 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:39.969043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:39.975565 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:39.976092 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:39.978074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:39.978730 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.124460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:40.132579 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-854748c7-7669-4785-b775-fb9700fd7dce tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.169391 May 12 15:39:40.133149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 162/342] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:39 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:40.272862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:40.273449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:40.280093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:40.280571 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.281350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:40.281796 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.429492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:40.439333 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-75f5517b-e49e-43a1-ba4b-12cbcd4bb675 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.170126 May 12 15:39:40.439907 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 181/343] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:40 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:40.575376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:40.575977 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:40.583344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:40.583799 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.584622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:40.585063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.650841 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:40.658733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3667e77b-40c8-46b1-a3c4-264d2c35a31a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1218 microversion: 2.1 time: 0.087256 May 12 15:39:40.659328 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 163/344] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:40 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:40.817799 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:40.818423 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:40.825190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:40.825670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.826670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:40.827104 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:40.975236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:40.985711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:40.987218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:40.988871 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b0ff85df-7dd5-4022-8a37-d22a01d384a3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.176347 May 12 15:39:40.989605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 182/345] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:40 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:41.150443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:41.153096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.161826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.162579 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.163931 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.164371 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.342850 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:41.352711 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9008b9ab-e015-46af-8479-28c0840a9501 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1267 microversion: 2.1 time: 0.206934 May 12 15:39:41.353826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 164/346] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:41 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:41.457828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:41.458441 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.464490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8706c9f-cde4-4b55-b9ad-afdc71b24911", "device": "/dev/sdb"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:41.465210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.465796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.466723 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.466867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.467314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.472743 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.473396 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.474159 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.474747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.637579 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:41.646611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e76dea1c-27d5-4900-adef-f348aa8b794b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1501 microversion: 2.1 time: 0.194222 May 12 15:39:41.647219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 165/347] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:41 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:41.663768 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7602effb-8532-46f4-863c-4300597aaf19"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:41.664868 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.674054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.674512 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.676511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.677629 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.707477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] HTTP exception thrown: Cannot 'attach_volume' instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f while it is in vm_state rescued May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Request method failure captured: May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/os-volume_attachments HTTP/1.1 May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 74 May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSnmslxjOw92y13wHry1lWnGADOsl6791JPT6gMnRLwjaADu5UkamgnmBKpOKr6X6iJ1JkGQAbaWm0pk7DkVPavaMt8-cwkw-sMdtcwmgS9L6qzNQyYFnh5Si8OR-0EOLjbRfOvjANcMd5yAPEZm9tunNuyIuvYgKqyAG8Xracq1I8A May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:39:41.709215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72d34bbf298a42fc943c77b2d90747e6", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: eaf5525a857c46ca9000626e60136eb9 May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {"volumeAttachment": {"volumeId": "7602effb-8532-46f4-863c-4300597aaf19"}} May 12 15:39:41.710764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Cannot 'attach_volume' instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f while it is in vm_state rescued May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'server_id': 'f2f2fa5c-7d16-4c2e-978e-c63f357f460f', 'body': {'volumeAttachment': {'volumeId': '7602effb-8532-46f4-863c-4300597aaf19'}}} May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:39:41.711668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f while it is in vm_state rescued May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:39:41.713021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f while it is in vm_state rescued May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Returning 409 to user: Cannot 'attach_volume' instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f while it is in vm_state rescued {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b003b9fc-49f1-41ab-89e0-34b70c93b99f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051132 May 12 15:39:41.714339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 166/348] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:39:41 2022] POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 12 15:39:41.716465 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:41.717093 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.723209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.723668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.724448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.724915 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.810804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:41.823188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-792c9a3a-5866-4866-bfb0-08cd7ae4f1b2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1266 microversion: 2.1 time: 0.110644 May 12 15:39:41.823933 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 167/349] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:41 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:41.831227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:41.833186 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.839645 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.840456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.841525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.842282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.960833 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4d529d78-743a-420c-a34d-f582b00a6c41 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/action" status: 202 len: 0 microversion: 2.1 time: 0.131595 May 12 15:39:41.961752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 168/350] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:39:41 2022] POST /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:39:41.977811 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:41.978736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:41.998434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:41.998775 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:41.999679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.000365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.145819 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:42.155535 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8d7a1c89-e078-4b72-8ebe-cc36c8b8a4d3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1509 microversion: 2.1 time: 0.181698 May 12 15:39:42.156326 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 169/351] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:41 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:42.161319 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:42.161982 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:42.168852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.169796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.171273 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.171726 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.316778 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:42.325631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:42.327165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:42.328355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1302a321-8603-46f1-8137-d74fe76bb735 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.171291 May 12 15:39:42.329031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 170/352] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:42 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:42.373851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:42.374460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:42.384176 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.384790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.386105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.386720 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.630493 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:42.640426 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-64d6f5f1-525e-477f-b8fd-318685d8c4a1 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1454 microversion: 2.1 time: 0.274084 May 12 15:39:42.648621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 171/353] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:42 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1454 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:42.661004 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:42.663508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:42.675160 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.679530 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.680420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.681091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.759987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-97ff5c20-0045-4570-b563-1768a0653ba8 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "POST /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.306065 May 12 15:39:42.764987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 183/354] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:39:41 2022] POST /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b/os-volume_attachments => generated 194 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:42.846596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:42.847254 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:42.858548 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.859003 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:42.860489 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:42.861092 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:43.010244 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:43.018116 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-980a05da-fea7-48da-9402-2e819e2ffce4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1272 microversion: 2.1 time: 0.180687 May 12 15:39:43.039456 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 184/355] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:42 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:43.045699 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:43.057579 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-77bfcf7b-20c5-4782-8493-fe6423263355 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1454 microversion: 2.1 time: 0.404119 May 12 15:39:43.058398 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 172/356] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:42 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1454 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:43.173922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:43.174841 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:43.186074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:43.186800 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:43.187582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:43.188016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:43.346776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:43.347295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:43.355034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:43.355481 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:43.359111 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:43.359582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:43.615786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:43.630779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-21412e2f-699b-4445-b962-75270700f68f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1509 microversion: 2.1 time: 0.462036 May 12 15:39:43.631450 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 185/357] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:43 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:43.752034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:43.762159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:43.766211 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:43.774252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-10aeb43c-63df-4507-8546-8590b9d38777 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.431443 May 12 15:39:43.787492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 173/358] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:43 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:44.035882 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:44.037572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:44.050280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.051163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:44.052181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.053393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:44.340668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:44.356083 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-22765f38-cad6-4647-95dc-3a057c0de97d tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.319933 May 12 15:39:44.357826 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 186/359] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:44 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:44.647707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:44.648318 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:44.655483 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.656251 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:44.657361 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.658024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:44.762918 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-8aa98e2e-ef52-400c-af30-d4dd93248d51 req-e42a3651-3f3c-4020-a0f7-967c3a238d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1273ea23-7656-4c2e-9a87-125a4d727e9e", "tag": "f7a894cb-afde-4654-8996-3476a3e605c1"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:44.775856 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8aa98e2e-ef52-400c-af30-d4dd93248d51 req-e42a3651-3f3c-4020-a0f7-967c3a238d3d service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.776299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8aa98e2e-ef52-400c-af30-d4dd93248d51 req-e42a3651-3f3c-4020-a0f7-967c3a238d3d service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:44.809131 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-8aa98e2e-ef52-400c-af30-d4dd93248d51 req-e42a3651-3f3c-4020-a0f7-967c3a238d3d service nova] Creating event network-changed:f7a894cb-afde-4654-8996-3476a3e605c1 for instance 1273ea23-7656-4c2e-9a87-125a4d727e9e on hv-cinder-83588 May 12 15:39:44.814281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-8aa98e2e-ef52-400c-af30-d4dd93248d51 req-e42a3651-3f3c-4020-a0f7-967c3a238d3d service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055186 May 12 15:39:44.815314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 187/360] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:39:44.821675 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:44.822771 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:44.829314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.829971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:44.830899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:44.832304 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:45.157115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:45.182142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c736165a-1734-4ff3-87ce-1d3240124d96 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1509 microversion: 2.1 time: 0.538532 May 12 15:39:45.182753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:45.195761 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 174/361] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:44 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:45.198437 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:45.200219 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:45.201478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-61896e7f-5847-434f-a781-25285f09c461 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.384863 May 12 15:39:45.202390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 188/362] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:44 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:45.374146 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:45.374863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:45.381716 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:45.382629 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:45.383778 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:45.384409 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:45.760007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:45.771403 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-28fadd9f-a790-4851-85d4-656e320b894f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.400932 May 12 15:39:45.772233 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 175/363] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:45 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:46.203012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:46.205592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:46.215113 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:46.215751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:46.216798 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:46.217408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:46.219992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:46.220675 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:46.233622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:46.238341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:46.239386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:46.244646 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:46.572859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:46.597466 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-799dcc5d-0bd5-4a09-a13f-ca975e8b13b3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1509 microversion: 2.1 time: 0.398530 May 12 15:39:46.608183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 189/364] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:46 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:46.658558 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:46.672530 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:46.680192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:46.684708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3b192386-c559-4a0e-925b-698af6d3bfab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.469229 May 12 15:39:46.685472 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 176/365] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:46 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:39:46.789878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:46.790838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:46.801853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:46.805867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:46.806959 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:46.809495 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:47.222432 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:47.232699 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cbe15632-c010-44de-80e1-6ef73fdf5be3 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.448119 May 12 15:39:47.233297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 190/366] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:46 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:47.546621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-58844af1-e69a-4c2a-899f-edb48d3a1a8c req-2f8a1ee0-59ad-4ca9-92c9-a50e301736b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc5f8be-b344-46fd-bae9-266847ebfdc1", "tag": "f92017be-34f1-4663-8133-b097ab792782"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:47.564419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-58844af1-e69a-4c2a-899f-edb48d3a1a8c req-2f8a1ee0-59ad-4ca9-92c9-a50e301736b6 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:47.567537 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-58844af1-e69a-4c2a-899f-edb48d3a1a8c req-2f8a1ee0-59ad-4ca9-92c9-a50e301736b6 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:47.600960 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-58844af1-e69a-4c2a-899f-edb48d3a1a8c req-2f8a1ee0-59ad-4ca9-92c9-a50e301736b6 service nova] Creating event network-changed:f92017be-34f1-4663-8133-b097ab792782 for instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 on hv-cinder-83588 May 12 15:39:47.614956 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-58844af1-e69a-4c2a-899f-edb48d3a1a8c req-2f8a1ee0-59ad-4ca9-92c9-a50e301736b6 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078277 May 12 15:39:47.615762 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:47.616378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:47.633556 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 177/367] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:39:47.635427 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:47.635907 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:47.636741 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:47.637181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:47.705865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:47.706863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:47.721609 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:47.722058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:47.722842 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:47.723274 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:48.080023 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:48.093940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a42063e0-b760-47d5-969c-e7a7f6f4ef0c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1515 microversion: 2.1 time: 0.482029 May 12 15:39:48.094963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 191/368] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:47 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1515 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:48.174763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:48.183168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:48.184715 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:48.185882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-04db8c0b-1d7f-4570-8073-58122fe320e2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.486492 May 12 15:39:48.193599 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 178/369] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:47 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:48.249833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:48.251225 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:48.262920 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:48.264310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:48.265356 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:48.266007 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:48.610969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:48.623159 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-10e1f733-d8e8-4f0a-ac7e-a977eda7b5b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.377014 May 12 15:39:48.626016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 192/370] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:48 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:49.208923 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:49.209521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:49.215784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:49.225578 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:49.226665 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:49.227318 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:49.607203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:49.621646 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:49.631082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:49.642010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:49.642626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:49.646025 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-15065cad-893d-45df-9349-ffe011133c30 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.437194 May 12 15:39:49.658734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:49.658734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:49.659169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 179/371] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:49 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:49.662003 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:49.662732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:49.692639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-bd813b53-6b0a-41a4-b69e-a976fbc8ec58 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'create', calling method: .version_select at 0x7f60d07a7b80>, body: {"keypair": {"name": "tempest-keypair-872514868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbj7VjK8SnCq84g7bRPFRiwr2d/VJrfXaqzbU7ZhD7tKXU0AGLrDD8ePgNuqV7pm3nTPbfEAlqKHV3Fq3oonVdof204vb4bPQU+qtMheQ+MyQgiRMwx07DvHs5jbDRgsA=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:49.724453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-bd813b53-6b0a-41a4-b69e-a976fbc8ec58 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:49.730054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-bd813b53-6b0a-41a4-b69e-a976fbc8ec58 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for user eaf5525a857c46ca9000626e60136eb9 and project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:49.790240 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-bd813b53-6b0a-41a4-b69e-a976fbc8ec58 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102320 May 12 15:39:49.801899 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 180/372] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:39:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:39:49.935360 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:49.946626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e09cc645-8216-4901-aed3-698709dd976a tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.309151 May 12 15:39:49.956192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 193/373] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:49 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:50.667333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:50.668057 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:50.681376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:50.682740 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:50.684861 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:50.686123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:50.949166 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:50.958985 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:50.961414 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:50.962874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-34d9261f-567d-4196-b551-3939285865fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.301091 May 12 15:39:50.976080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 181/374] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:50 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:50.977121 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:50.978256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:50.988602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:50.990566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:50.991622 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:50.998332 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:51.199831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:51.210954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3bd2db70-8773-481d-a4fa-c8bab7db0542 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.240464 May 12 15:39:51.216705 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 194/375] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:50 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:51.984552 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:51.986023 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:51.996510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:51.996968 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:51.997774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:51.998215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:52.253520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:52.254165 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:52.279114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:52.282639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:52.284820 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:52.285020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:52.561795 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:52.571040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:52.578851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:52.580561 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7907b335-ef1c-4f43-a52f-921a3a662560 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.599866 May 12 15:39:52.581304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 182/376] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:51 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:52.798735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:52.811053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-677216be-41c5-49e4-aead-8b390d942e65 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.580993 May 12 15:39:52.815916 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 195/377] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:52 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:53.601272 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:53.602560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:53.617948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:53.619635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:53.620752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:53.621616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:53.831160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:53.832319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:53.839791 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:53.840241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:53.841049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:53.841882 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:53.998273 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:54.007782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:54.009620 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:54.011228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-28a301b9-d072-4ab4-a1a8-ff57a7208352 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.415722 May 12 15:39:54.011794 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 183/378] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:53 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:54.091238 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:54.101849 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5fe85ee3-55d0-4c65-878a-2bec5b3bffef tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.274414 May 12 15:39:54.102749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 196/379] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:53 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:54.171667 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-664188094", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "face382c-cf88-455e-a792-36e0eb4696a1"}], "security_groups": [{"name": "tempest-securitygroup--1713082136"}], "key_name": "tempest-keypair-872514868", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:54.281125 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] validate_networks() for [('face382c-cf88-455e-a792-36e0eb4696a1', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:39:54.700613 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:39:54.701803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:39:54.702311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:39:54.702725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:39:54.703175 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:39:54.713119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:54.713888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:54.714845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:54.715276 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:54.734030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:54.740796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Getting quotas for user eaf5525a857c46ca9000626e60136eb9 and project 72d34bbf298a42fc943c77b2d90747e6. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:54.752433 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:39:54.755581 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:39:54.810070 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7af6bf80-b816-4d04-91d2-25e14f23fb50 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.643924 May 12 15:39:54.815587 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 184/380] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:39:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:39:54.820924 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8814bc40-5b4a-4dd1-87c1-4cba84f70a88 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:54.821763 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8814bc40-5b4a-4dd1-87c1-4cba84f70a88 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:54.890020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8814bc40-5b4a-4dd1-87c1-4cba84f70a88 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:54.897151 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8814bc40-5b4a-4dd1-87c1-4cba84f70a88 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1244 microversion: 2.1 time: 0.080168 May 12 15:39:54.907355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 197/381] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:54 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:55.033438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:55.034055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:55.040802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:55.041599 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:55.042579 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:55.043304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:55.124168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:55.125729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:55.133985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:55.135675 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:55.136805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:55.137452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:55.224067 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:55.232168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:55.233725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:55.244850 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-66461f84-0125-41a0-8cef-50e468817ade tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1736 microversion: 2.20 time: 0.205508 May 12 15:39:55.245748 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 185/382] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:55 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:55.353097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:55.361075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1fad087c-444e-4399-b916-dc236fc051bd tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.244140 May 12 15:39:55.361645 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 198/383] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:55 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:55.914125 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:55.914735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:55.921895 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:55.922410 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:55.923196 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:55.923809 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:55.998043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:56.009245 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e9d57e3f-1456-4710-81ff-acbcd80188a4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1296 microversion: 2.1 time: 0.096610 May 12 15:39:56.011447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 186/384] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:55 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:56.263650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:56.264259 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:56.271899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:56.272686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:56.273642 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:56.274302 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:56.378255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:56.378869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:56.400934 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:56.401706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:56.402611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:56.403123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:56.478130 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:56.493264 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:56.502759 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:56.504393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-eddb9ff8-6752-4491-92e7-72ee83178914 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.244683 May 12 15:39:56.516606 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 199/385] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:56 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:56.720406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:56.737134 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ad7084f4-e87f-4f46-8d80-001f99b1ff92 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.356951 May 12 15:39:56.752872 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 187/386] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:56 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:57.027993 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:57.028703 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:57.038985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:57.041609 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:57.044834 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:57.045292 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:57.203990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:57.216550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9f34d10a-a018-4934-9dbc-c92d802f34e7 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1302 microversion: 2.1 time: 0.192881 May 12 15:39:57.217455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 200/387] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:57 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1302 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:57.523334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:57.523927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:57.542007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:57.542709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:57.543948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:57.544379 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:57.769019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:57.770400 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:57.782095 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:57.784767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:57.787613 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:57.788323 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:57.811838 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:57.822141 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:57.826220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:57.831558 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e348f6cc-f3a8-4bad-b40d-5b13b3c2e2d2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.312165 May 12 15:39:57.832438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 188/388] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:57 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:39:58.115144 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:58.125128 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0defa1b2-01d1-40fd-8bbb-f36ab14b2716 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.359869 May 12 15:39:58.125783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 201/389] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:57 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:39:58.234142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:58.235265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:58.245145 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:58.245952 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:58.250727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:58.252332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:58.339071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:58.347545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3766bac4-ccab-4db4-9c5a-88ef2cfb640c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1302 microversion: 2.1 time: 0.117252 May 12 15:39:58.348740 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 189/390] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:58 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1302 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:58.850516 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:58.851117 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:58.860183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:58.860998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:58.861992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:58.862659 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:59.090392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:59.103236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:59.106621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:59.107817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e098f572-5e98-4ca0-9cd1-6919b38e83d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.261441 May 12 15:39:59.108421 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 202/391] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:39:58 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:39:59.142631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:59.143350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:59.159540 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:59.160321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:59.161817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:59.162523 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:59.367935 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:39:59.368593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:39:59.379347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:59.379917 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:59.380741 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:39:59.381178 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:39:59.389594 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:59.399056 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c6080857-54bf-4ea6-8bc2-5bcfa31a4a84 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.260335 May 12 15:39:59.407540 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 190/392] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:59 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:59.504729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:39:59.516110 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-597b4665-91b7-46f8-95f1-47f9f946cd42 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1302 microversion: 2.1 time: 0.152283 May 12 15:39:59.517795 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 203/393] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:39:59 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1302 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:39:59.915619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7d834a4b-5307-4230-9ad5-02348a0fce55 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Action: 'create', calling method: .version_select at 0x7f60d092a040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1369134100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkHBXUTnZvhybc65SDZ88CbkEz3qDpO58Ie3/CkQ1UL5NUb2DLGWvoft/9GLPhowfFs0vvgn8F6DcVwqPAz6+jtLJdQrk2vXlDmgYuR8qMSlUMP2ihwnZnkCxsbzCLUvw=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:39:59.934494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-7d834a4b-5307-4230-9ad5-02348a0fce55 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Getting quotas for project e085f63cf59c49a2847cbf228d7e609c. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:39:59.939168 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-7d834a4b-5307-4230-9ad5-02348a0fce55 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Getting quotas for user a61ad9366b5845b5bbf8e8e1fdb649e6 and project e085f63cf59c49a2847cbf228d7e609c. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:39:59.964695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7d834a4b-5307-4230-9ad5-02348a0fce55 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.253666 May 12 15:39:59.965307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 191/394] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:39:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:40:00.126329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:00.127794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:00.135441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:00.136157 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:00.137320 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:00.137740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:00.283730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:00.291969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:00.293847 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:00.295172 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6fd14d7d-3485-4ed5-b0d2-b590508dfba4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.172940 May 12 15:40:00.295749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 204/395] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:00 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:00.423706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:00.424312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:00.431655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:00.432105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:00.433054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:00.433616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:00.538152 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:00.538743 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:00.545964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:00.546440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:00.547255 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:00.547689 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:00.577912 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:00.586167 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-08f2dfd9-d84c-41a4-a009-88daa22a693e tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.166222 May 12 15:40:00.587308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 192/396] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:00 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:00.617163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:00.625421 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3ddf6663-00a0-4ec4-b3fc-48f58f7dcbce tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1302 microversion: 2.1 time: 0.092898 May 12 15:40:00.626198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 205/397] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:00 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:01.314112 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:01.315012 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:01.322931 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.323736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.325046 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.325702 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.426759 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-971222f5-7667-4f6a-b670-7e7f11b0c299 req-e241694a-c531-4fec-8087-647f17497eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1273ea23-7656-4c2e-9a87-125a4d727e9e", "name": "network-vif-plugged", "status": "completed", "tag": "f7a894cb-afde-4654-8996-3476a3e605c1"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:01.444963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-971222f5-7667-4f6a-b670-7e7f11b0c299 req-e241694a-c531-4fec-8087-647f17497eda service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.445720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-971222f5-7667-4f6a-b670-7e7f11b0c299 req-e241694a-c531-4fec-8087-647f17497eda service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.459546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-971222f5-7667-4f6a-b670-7e7f11b0c299 req-e241694a-c531-4fec-8087-647f17497eda service nova] Creating event network-vif-plugged:f7a894cb-afde-4654-8996-3476a3e605c1 for instance 1273ea23-7656-4c2e-9a87-125a4d727e9e on hv-cinder-83588 May 12 15:40:01.466201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-971222f5-7667-4f6a-b670-7e7f11b0c299 req-e241694a-c531-4fec-8087-647f17497eda service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043833 May 12 15:40:01.467485 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 206/398] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:01.497010 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:01.505688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:01.507223 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:01.508396 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6c6eb93e-4ce3-42f2-9255-2881ffbaaaad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.198772 May 12 15:40:01.508990 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 193/399] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:01 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:01.605298 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:01.606052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:01.612789 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.613336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.614331 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.615589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.644008 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:01.644789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:01.651132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.651870 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.652993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:01.653441 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:01.747389 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:01.756053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-81ce9787-448a-415b-b453-f425f1ca8fa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1302 microversion: 2.1 time: 0.116153 May 12 15:40:01.756789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 194/400] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:01 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:01.806658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:01.814314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6c3afdd0-fb72-4e77-b61b-6b919e665036 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.214497 May 12 15:40:01.814866 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 207/401] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:01 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:02.532755 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:02.533863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:02.542419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:02.543833 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:02.544621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:02.545237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:02.681969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:02.719382 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:02.727701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:02.729615 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9a2d01d1-64ad-4785-8da8-819b4581515e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.205958 May 12 15:40:02.730655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 195/402] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:02 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:02.775095 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:02.775815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:02.792728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:02.793192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:02.794368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:02.794819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:02.831803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:02.832451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:02.841294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:02.843941 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:02.846236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:02.846760 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:02.880226 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:02.891663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-90f73984-7fef-4f7b-9de3-eb5c3e0cf63b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1302 microversion: 2.1 time: 0.122408 May 12 15:40:02.892666 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 208/403] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:02 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:03.033252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:03.042546 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8df994f4-6c2b-4336-8ca4-b3bd9d7378e9 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.215279 May 12 15:40:03.043825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 196/404] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:02 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:03.481194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-4a40ee7d-418b-450c-b76c-29dcf9573b97 req-68b189f9-b7d3-4da2-86d8-63953aaa9a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "name": "network-vif-unplugged", "status": "completed", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:03.489919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4a40ee7d-418b-450c-b76c-29dcf9573b97 req-68b189f9-b7d3-4da2-86d8-63953aaa9a08 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:03.490368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4a40ee7d-418b-450c-b76c-29dcf9573b97 req-68b189f9-b7d3-4da2-86d8-63953aaa9a08 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:03.503038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-4a40ee7d-418b-450c-b76c-29dcf9573b97 req-68b189f9-b7d3-4da2-86d8-63953aaa9a08 service nova] Creating event network-vif-unplugged:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:40:03.514602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-4a40ee7d-418b-450c-b76c-29dcf9573b97 req-68b189f9-b7d3-4da2-86d8-63953aaa9a08 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036824 May 12 15:40:03.515641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 209/405] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:03.753345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:03.754832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:03.766625 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:03.767080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:03.767877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:03.768576 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:03.902649 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:03.910526 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:03.911223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:03.911484 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:03.913030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:03.914252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cbc3f91c-2b43-4487-a250-1881f947f27d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.168324 May 12 15:40:03.914817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 197/406] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:03 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:03.918068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:03.918881 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:03.919673 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:03.920100 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:04.058357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:04.059857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:04.060653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:04.066999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e1bb5511-60bd-47b2-b121-27afda6e11aa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.161127 May 12 15:40:04.067292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:04.067593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 210/407] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:03 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:04.067877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:04.069051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:04.069542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:04.206614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:04.214160 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5cb4a510-862b-42b6-a1a2-3fa6b02c9e33 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.158074 May 12 15:40:04.214728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 198/408] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:04 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:04.935127 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:04.935733 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:04.943574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:04.944024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:04.944857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:04.945291 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:05.082088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:05.083624 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:05.084210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:05.090846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:05.091700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:05.092147 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:05.092338 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:05.093086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:05.093527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:05.093690 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b7f26468-9e28-41b8-aaf6-39adf57c3d7f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.163662 May 12 15:40:05.094193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 211/409] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:04 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:05.231027 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:05.231445 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:05.231643 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:05.238238 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:05.238695 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:05.239337 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d622796d-f85b-4ac6-b5b7-b0251a4ae287 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.159665 May 12 15:40:05.239491 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:05.239943 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:05.248798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 199/410] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:05 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:05.378109 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:05.386050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2dd4e642-bc4c-4836-88a0-44fe06d7604f tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.158920 May 12 15:40:05.386606 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 212/411] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:05 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:06.112163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:06.112817 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:06.119243 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.119681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.120443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.120874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.257622 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:06.258263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:06.259774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:06.266323 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.266657 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.267452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.268055 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.271760 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:06.273607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:06.275189 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4cf00606-f789-4caa-8fcb-e795577043dd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1718 microversion: 2.20 time: 0.167210 May 12 15:40:06.275860 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 200/412] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:06 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:06.404823 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:06.406222 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:06.414205 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.415080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.416024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.416646 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.589375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:06.598858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7ca33de4-b8c3-4585-929a-001dd4d88df0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.347343 May 12 15:40:06.599519 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 213/413] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:06 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:06.604680 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-65e8c511-70cb-45ec-a0e9-5e759480142b req-d4a018dc-add5-4d71-8ce2-abc0ff4a835e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa53a7ea-5acc-4021-ac22-69d92ef87b71", "tag": "5ece189e-0f97-4933-9eeb-db6e18b9f97b"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:06.613533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-65e8c511-70cb-45ec-a0e9-5e759480142b req-d4a018dc-add5-4d71-8ce2-abc0ff4a835e service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:06.614450 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-65e8c511-70cb-45ec-a0e9-5e759480142b req-d4a018dc-add5-4d71-8ce2-abc0ff4a835e service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:06.636399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-65e8c511-70cb-45ec-a0e9-5e759480142b req-d4a018dc-add5-4d71-8ce2-abc0ff4a835e service nova] Creating event network-changed:5ece189e-0f97-4933-9eeb-db6e18b9f97b for instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 on hv-cinder-83588 May 12 15:40:06.647307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-65e8c511-70cb-45ec-a0e9-5e759480142b req-d4a018dc-add5-4d71-8ce2-abc0ff4a835e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044624 May 12 15:40:06.655767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 214/414] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:06.660318 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:06.673370 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-eb92d3ac-0e1f-497c-97f3-bc881b08c780 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1314 microversion: 2.1 time: 0.274201 May 12 15:40:06.674152 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 201/415] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:06 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:07.300720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:07.302012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:07.313068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.313439 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.314255 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.314691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.449948 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:07.459639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:07.461190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:07.462347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7451bd04-cbd9-4ddb-bc86-15933a8c4d2a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1721 microversion: 2.20 time: 0.170088 May 12 15:40:07.462957 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 215/416] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:07 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:07.480249 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beeb439a-3691-46d4-b42c-33c878c7cd20"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:07.481429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:07.488296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.488756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.489562 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.490001 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.618080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:07.619089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:07.626084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.626535 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.627297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.627737 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.917261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a5198e29-238c-4fa8-80bb-5b3aac23fc3e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.440974 May 12 15:40:07.918026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 202/417] 10.222.0.89 () {62 vars in 1363 bytes} [Thu May 12 15:40:07 2022] POST /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments => generated 188 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:40:07.923435 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:07.923520 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:07.930166 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.930679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.931459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:07.931889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:07.941849 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:07.953620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9087086b-ddb3-4011-8ec4-85c9a9da47e3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.340785 May 12 15:40:07.954934 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 216/418] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:07 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:08.048206 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:08.049084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:08.054999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.055630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.056406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.056872 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.073372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:08.081172 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4b20952f-e812-4922-9e03-16308657f934 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1497 microversion: 2.1 time: 0.161760 May 12 15:40:08.081987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 203/419] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:07 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:08.159399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b29f8e23-3598-4237-9c71-ed605808cfe9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/action" status: 202 len: 0 microversion: 2.20 time: 0.115729 May 12 15:40:08.159993 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 217/420] 10.222.0.89 () {62 vars in 1318 bytes} [Thu May 12 15:40:08 2022] POST /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 15:40:08.168974 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:08.170152 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:08.176031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.176509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.177263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.177701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.342049 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:08.363460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:08.367090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:08.371644 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b54b4087-ca7c-4a6a-a9cd-7234d31aa235 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1747 microversion: 2.20 time: 0.206888 May 12 15:40:08.372351 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 204/421] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:08 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1747 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:08.838408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:08.839256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:08.845397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.845846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.846619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.848324 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.903937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:40:08.970764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:08.971386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:08.979715 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.980381 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:08.981569 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:08.982223 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:09.019224 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ade90bed-ee50-4fa2-9ae0-a1411b258961 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "DELETE /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 204 len: 0 microversion: 2.1 time: 0.184005 May 12 15:40:09.023476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 218/422] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:40:08 2022] DELETE /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:40:09.030128 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:09.030855 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:09.037101 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:09.037506 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:09.038524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:09.038830 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:09.173679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:09.183298 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-66bac5f9-5df4-4e09-9c82-f64780a00bda tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.216791 May 12 15:40:09.184638 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 205/423] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:08 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:09.205004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:09.212798 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7eb42d34-cf98-47cf-90e4-80d5f33d2a00 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1503 microversion: 2.1 time: 0.188212 May 12 15:40:09.213374 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 219/424] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:09 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:09.393223 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:09.394012 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:09.403677 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:09.404364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:09.405604 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:09.406398 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:09.538101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:09.546909 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:09.548399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:09.549586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-02550520-86ed-466f-9fe6-1b0dd840f6d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1747 microversion: 2.20 time: 0.162653 May 12 15:40:09.550149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 206/425] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:09 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:10.036045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:10.036662 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:10.043900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.044349 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.045175 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.045610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.175783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lazy-loading 'services' on Instance uuid af588d39-4bcd-46c2-85fa-1c742b2daf8b {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:10.200903 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:10.201533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:10.208366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.208853 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.209625 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.210134 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.294180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8382ae7f-cdb5-4b5b-b569-e35dba8da5d4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "DELETE /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b/os-volume_attachments/c8706c9f-cde4-4b55-b9ad-afdc71b24911" status: 202 len: 0 microversion: 2.1 time: 0.262572 May 12 15:40:10.294782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 220/426] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:40:10 2022] DELETE /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b/os-volume_attachments/c8706c9f-cde4-4b55-b9ad-afdc71b24911 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:40:10.300129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:10.300917 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:10.310840 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.311217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.312005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.312518 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.350282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:10.357863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ac07ad66-cf76-45fa-abaa-d85a7c4c944c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.160913 May 12 15:40:10.358462 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 207/427] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:10 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:10.452796 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:10.460908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-470b76fc-8126-420c-808f-42e2308621df tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1503 microversion: 2.1 time: 0.164990 May 12 15:40:10.461477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 221/428] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:10 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:10.570924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:10.570924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:10.576883 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.577376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.578325 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:10.578853 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:10.719611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:10.728777 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:10.730509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:10.731705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f0f82689-272b-4bea-a14e-e542cbf0439c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1747 microversion: 2.20 time: 0.166832 May 12 15:40:10.732277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 208/429] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:10 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1747 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:11.379279 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:11.380393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:11.391342 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:11.392064 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:11.393099 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:11.393562 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:11.485707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:11.486368 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:11.493776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:11.494339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:11.495401 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:11.495881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:11.569190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:11.576439 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2d6c5e7e-f336-4c1e-b896-dcb73c5db30d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.204077 May 12 15:40:11.577034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 222/430] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:11 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:11.654603 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:11.663919 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8316528c-ae06-4875-afd5-c74841f959e4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1503 microversion: 2.1 time: 0.189444 May 12 15:40:11.664684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 209/431] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:11 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:11.750826 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:11.751421 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:11.758096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:11.758667 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:11.759440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:11.759871 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:11.898307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:11.910687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:11.912962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:11.914835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c5c2445d-4bc8-411c-8929-47de43b24ad4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1749 microversion: 2.20 time: 0.167845 May 12 15:40:11.915610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 223/432] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:11 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:12.596426 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:12.597090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:12.604096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:12.604568 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:12.605331 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:12.605757 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:12.681362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:12.682021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:12.690229 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:12.691019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:12.691798 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:12.692505 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:12.765037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:12.772482 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-524f9763-1195-43ee-97e4-f85452e7a797 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.181447 May 12 15:40:12.773255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 210/433] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:12 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:12.862601 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:12.870807 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ff7bc94c-6972-41b1-b65f-63be1756ff80 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1503 microversion: 2.1 time: 0.193654 May 12 15:40:12.871510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 224/434] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:12 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:12.936829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:12.937315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:12.944142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:12.944936 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:12.945804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:12.946459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.116650 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:13.126859 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:13.128507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:13.129382 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-1830d431-517b-46ac-a0ce-0aa16755f43e req-18db78a9-c9ac-4ada-87a6-e7f64816b156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1273ea23-7656-4c2e-9a87-125a4d727e9e", "name": "network-vif-deleted", "tag": "f7a894cb-afde-4654-8996-3476a3e605c1"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:13.130373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5ac43543-42a0-4c19-a0ce-e515e15209e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1749 microversion: 2.20 time: 0.198302 May 12 15:40:13.131140 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 211/435] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:12 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:13.144950 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1830d431-517b-46ac-a0ce-0aa16755f43e req-18db78a9-c9ac-4ada-87a6-e7f64816b156 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.145348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1830d431-517b-46ac-a0ce-0aa16755f43e req-18db78a9-c9ac-4ada-87a6-e7f64816b156 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.158129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-1830d431-517b-46ac-a0ce-0aa16755f43e req-18db78a9-c9ac-4ada-87a6-e7f64816b156 service nova] Creating event network-vif-deleted:f7a894cb-afde-4654-8996-3476a3e605c1 for instance 1273ea23-7656-4c2e-9a87-125a4d727e9e on hv-cinder-83588 May 12 15:40:13.163461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-1830d431-517b-46ac-a0ce-0aa16755f43e req-18db78a9-c9ac-4ada-87a6-e7f64816b156 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 May 12 15:40:13.164341 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 225/436] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:13.550432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:13.550936 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:13.557297 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.557743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.558521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.558953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.583765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:40:13.676583 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9537275e-b5f3-4e6f-8b49-9156aa1cdd23 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "DELETE /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 204 len: 0 microversion: 2.1 time: 0.130647 May 12 15:40:13.677425 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 212/437] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:40:13 2022] DELETE /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:40:13.687766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:13.688544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:13.695170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.695627 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.696399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.696884 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.789146 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:13.790111 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:13.796970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.797720 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.798659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.799100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.837878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:13.845896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3c5dde39-aa33-4d3e-9c02-6cdd828bd76a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1512 microversion: 2.1 time: 0.163476 May 12 15:40:13.847034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 226/438] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:13 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:13.888656 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:13.889268 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:13.896087 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.896775 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.897715 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.898166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.932350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:13.932842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:13.933379 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lazy-loading 'fault' on Instance uuid 1273ea23-7656-4c2e-9a87-125a4d727e9e {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:13.946303 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:13.955860 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7185de2b-a3b3-4929-8931-ac38b129e1e4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.170826 May 12 15:40:13.956789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 213/439] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:13 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:13.979481 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:13.989081 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-dd401669-6ef1-4cc5-bce9-d82a5ca520b4 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1304 microversion: 2.1 time: 0.104309 May 12 15:40:13.989696 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 227/440] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:13 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:14.148493 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:14.149113 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:14.155563 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:14.156007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:14.157061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:14.157487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:14.290544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:14.299465 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:14.301002 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:14.302165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2d180b44-bddc-4d8b-be2d-f87001974832 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1749 microversion: 2.20 time: 0.157639 May 12 15:40:14.302706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 214/441] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:14 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:14.867999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:14.868982 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:14.879296 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:14.880046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:14.881363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:14.882074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:14.973704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:14.974305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:14.981022 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:14.981463 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:14.982225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:14.982648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.022498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:15.031015 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7adc56f1-2ae5-4eb1-b473-bcaeb270c82e tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1512 microversion: 2.1 time: 0.170034 May 12 15:40:15.031633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 228/442] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:14 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:15.036329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:15.036958 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:15.043630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:15.044103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.044963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:15.045441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.077353 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:15.077504 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.077924 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lazy-loading 'fault' on Instance uuid 1273ea23-7656-4c2e-9a87-125a4d727e9e {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:15.126034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cb7f175f3423384aedd412a653168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15ed6d55b50c4f23bbd4df6b850e9466', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:15.133804 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bdaefbf6-5b44-4a10-94ff-1021813c00c5 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 200 len: 1304 microversion: 2.1 time: 0.101225 May 12 15:40:15.134415 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 229/443] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:15 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:15.147294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:15.154722 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-75b9cbbd-e120-4c3a-a76c-e8aba882b822 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.184955 May 12 15:40:15.155292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 215/444] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:14 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:15.321103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:15.321702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:15.328069 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:15.328511 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.329298 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:15.329732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.473021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:15.482355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:15.484063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:15.485366 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6899a407-e8b0-4197-914f-d4bfee5829c8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1749 microversion: 2.20 time: 0.168308 May 12 15:40:15.486228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 230/445] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:15 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:15.955863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-6a95da40-80d9-4684-8b60-a3437b93a474 req-19ca79ff-420a-44c3-980b-6764b096f076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa53a7ea-5acc-4021-ac22-69d92ef87b71", "name": "network-vif-plugged", "status": "completed", "tag": "5ece189e-0f97-4933-9eeb-db6e18b9f97b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:15.965800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-6a95da40-80d9-4684-8b60-a3437b93a474 req-19ca79ff-420a-44c3-980b-6764b096f076 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:15.966246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-6a95da40-80d9-4684-8b60-a3437b93a474 req-19ca79ff-420a-44c3-980b-6764b096f076 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:15.979925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-6a95da40-80d9-4684-8b60-a3437b93a474 req-19ca79ff-420a-44c3-980b-6764b096f076 service nova] Creating event network-vif-plugged:5ece189e-0f97-4933-9eeb-db6e18b9f97b for instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 on hv-cinder-83588 May 12 15:40:15.985644 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-6a95da40-80d9-4684-8b60-a3437b93a474 req-19ca79ff-420a-44c3-980b-6764b096f076 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 May 12 15:40:15.986246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 216/446] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:16.048857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:16.049655 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:16.056095 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.056592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.057372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.057809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.152809 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:16.153553 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] [instance: 1273ea23-7656-4c2e-9a87-125a4d727e9e] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:16.160511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.160983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.161758 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.162196 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.177231 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] HTTP exception thrown: Instance 1273ea23-7656-4c2e-9a87-125a4d727e9e could not be found. May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Request method failure captured: May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e HTTP/1.1 May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSoNAy66ovA9ID72feCQbiUtENEjIYvvWs7Oj9ipsxIok7juMMB6G3RITAoSo7NWevAsGH2Tqy4zhLr9yMAwtOFiudcUzJgaFwdPgXGLAmjCh78wiPEvrx6BUc3v3afSS14lUKJxIjB7F97aEwjFIU2_CJ-FOJdSn6cyx3N5Z0OCNQw May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 15ed6d55b50c4f23bbd4df6b850e9466 May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-VolumesActionsTest-422514033 May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:40:16.178781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_15ed6d55b50c4f23bbd4df6b850e9466", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/15ed6d55b50c4f23bbd4df6b850e9466"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/15ed6d55b50c4f23bbd4df6b850e9466"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/15ed6d55b50c4f23bbd4df6b850e9466"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-VolumesActionsTest-422514033 May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 15ed6d55b50c4f23bbd4df6b850e9466 May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-VolumesActionsTest-422514033 May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-VolumesActionsTest-422514033-project May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: 5e0cb7f175f3423384aedd412a653168 May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-VolumesActionsTest-422514033-project May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 1273ea23-7656-4c2e-9a87-125a4d727e9e could not be found. May 12 15:40:16.180545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '1273ea23-7656-4c2e-9a87-125a4d727e9e'} May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1273ea23-7656-4c2e-9a87-125a4d727e9e could not be found. May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:40:16.181444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1273ea23-7656-4c2e-9a87-125a4d727e9e could not be found. May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1273ea23-7656-4c2e-9a87-125a4d727e9e could not be found. May 12 15:40:16.182914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:40:16.185228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] Returning 404 to user: Instance 1273ea23-7656-4c2e-9a87-125a4d727e9e could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:40:16.185228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b48ef824-6fd4-4ef5-807f-543c20bfeac2 tempest-VolumesActionsTest-422514033 tempest-VolumesActionsTest-422514033-project] 10.222.0.89 "GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e" status: 404 len: 111 microversion: 2.1 time: 0.032201 May 12 15:40:16.185228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 217/447] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:16 2022] GET /compute/v2.1/servers/1273ea23-7656-4c2e-9a87-125a4d727e9e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:40:16.188724 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:16.189513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:16.193576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:16.196444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.196941 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.197725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.198169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.202573 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-09a6d7cc-644a-4243-ac14-ddcd67970608 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1512 microversion: 2.1 time: 0.157704 May 12 15:40:16.203157 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 231/448] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:16 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:16.503262 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:16.503866 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:16.523326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.523326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.523326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.523326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.842007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:16.852735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-07f335f9-8d40-418b-95cf-d27a7b2b615b tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.667345 May 12 15:40:16.853617 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 218/449] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:16 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:16.859129 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-63cc34c1-7785-49fa-8974-0de48c77fc4b req-75f9a0df-999b-4da8-b47c-60e5957c9a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af588d39-4bcd-46c2-85fa-1c742b2daf8b", "name": "network-vif-deleted", "tag": "b4989380-2070-444e-9bc2-b81db642016c"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:16.871998 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-63cc34c1-7785-49fa-8974-0de48c77fc4b req-75f9a0df-999b-4da8-b47c-60e5957c9a93 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:16.872492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-63cc34c1-7785-49fa-8974-0de48c77fc4b req-75f9a0df-999b-4da8-b47c-60e5957c9a93 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:16.890028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-63cc34c1-7785-49fa-8974-0de48c77fc4b req-75f9a0df-999b-4da8-b47c-60e5957c9a93 service nova] Creating event network-vif-deleted:b4989380-2070-444e-9bc2-b81db642016c for instance af588d39-4bcd-46c2-85fa-1c742b2daf8b on hv-cinder-83588 May 12 15:40:16.896334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-63cc34c1-7785-49fa-8974-0de48c77fc4b req-75f9a0df-999b-4da8-b47c-60e5957c9a93 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040845 May 12 15:40:16.897567 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 219/450] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:16.992742 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:17.001378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:17.003287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:17.004555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6e73d8f6-2546-40ca-ac51-4d8209053de7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.505228 May 12 15:40:17.005313 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 232/451] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:16 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:17.222539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:17.223235 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:17.229980 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:17.230437 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:17.231213 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:17.231656 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:17.262887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:17.263337 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:17.263796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lazy-loading 'fault' on Instance uuid af588d39-4bcd-46c2-85fa-1c742b2daf8b {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:17.312985 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:17.320516 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-109abfa4-0f19-4f14-9743-b90ce046b7bc tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1308 microversion: 2.1 time: 0.102779 May 12 15:40:17.321155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 220/452] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:17 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:17.874158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:17.874992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:17.885971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:17.886728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:17.887988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:17.888760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:18.023165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:18.023770 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:18.029801 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:18.030248 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:18.030926 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:18.031068 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:18.031443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:18.040288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-675b6d59-f0ec-42a8-984d-149273e513e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.171386 May 12 15:40:18.040934 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 233/453] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:17 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:18.164320 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:18.173561 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:18.175163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:18.176324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3c773c05-8503-4159-b843-7001c03d67a9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.157242 May 12 15:40:18.177007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 221/454] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:18 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:18.337687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:18.338301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:18.344834 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:18.345300 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:18.346079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:18.346565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:18.378598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:18.379050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:18.379510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lazy-loading 'fault' on Instance uuid af588d39-4bcd-46c2-85fa-1c742b2daf8b {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:18.420038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:18.427584 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-81ea76fb-6d9d-428b-99f4-108870b1fc65 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1308 microversion: 2.1 time: 0.093905 May 12 15:40:18.428182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 234/455] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:18 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:19.062316 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:19.063330 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:19.071639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.072137 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.073122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.073576 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.194460 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:19.195029 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:19.201527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.201977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.202743 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.203182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.214179 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:19.221706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0b88fe5a-b69b-4daf-9254-2cdfa65e7cb0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.166123 May 12 15:40:19.222281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 222/456] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:19 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:19.335675 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:19.348224 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:19.350564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:19.352260 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d7061dc0-2d12-4f9a-a038-43d8dfc2f439 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.161788 May 12 15:40:19.353019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 235/457] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:19 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:19.444236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:19.444932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:19.451014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.451457 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.452220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.452688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.486332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:19.486776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:19.487219 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lazy-loading 'fault' on Instance uuid af588d39-4bcd-46c2-85fa-1c742b2daf8b {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:19.537845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:19.545926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ba458e20-f9da-450a-a322-399cbcb98c32 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 200 len: 1308 microversion: 2.1 time: 0.105554 May 12 15:40:19.546495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 223/458] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:19 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:20.242819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:20.243827 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:20.254631 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:20.255385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:20.256730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:20.257466 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:20.374756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:20.375377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:20.382497 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:20.382950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:20.384016 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:20.384495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:20.477793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:20.487525 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-09b81936-7544-402d-a59c-a34a4890b6ee tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.251098 May 12 15:40:20.488299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 236/459] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:20 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:20.562284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:20.563008 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: af588d39-4bcd-46c2-85fa-1c742b2daf8b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:20.569024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:20.569676 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:20.570707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:20.571509 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:20.586036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] HTTP exception thrown: Instance af588d39-4bcd-46c2-85fa-1c742b2daf8b could not be found. May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Request method failure captured: May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b HTTP/1.1 May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSoJMI7xMIR94diMfbsxEGomuST9Rd3jscrU5rWIUwkPCOHdmqNI5kMkLuGq_7QyH9haLm-bdaSio5Zi94P20xWHMk9qvr8LDyVTnYl9CMo84_F_2IUYT9eZvQXhaIoZ057jYur6ayJt8oFSYud1TyXaH4lCg7ovJ5aRTLz-b-dICIk May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 24ad1bfe4f634a188dd1613c630f0bbd May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1312221365 May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:40:20.587691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_24ad1bfe4f634a188dd1613c630f0bbd", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/24ad1bfe4f634a188dd1613c630f0bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/24ad1bfe4f634a188dd1613c630f0bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/24ad1bfe4f634a188dd1613c630f0bbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesSnapshotTestJSON-1312221365 May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 24ad1bfe4f634a188dd1613c630f0bbd May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1312221365 May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesSnapshotTestJSON-1312221365-project May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 1867e3f3c9ad42de8fa552c1c39f0fcd May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesSnapshotTestJSON-1312221365-project May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance af588d39-4bcd-46c2-85fa-1c742b2daf8b could not be found. May 12 15:40:20.589183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'af588d39-4bcd-46c2-85fa-1c742b2daf8b'} May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af588d39-4bcd-46c2-85fa-1c742b2daf8b could not be found. May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:40:20.590075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af588d39-4bcd-46c2-85fa-1c742b2daf8b could not be found. May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af588d39-4bcd-46c2-85fa-1c742b2daf8b could not be found. May 12 15:40:20.591329 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:40:20.592499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Returning 404 to user: Instance af588d39-4bcd-46c2-85fa-1c742b2daf8b could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:40:20.592499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c6ff308b-5270-452b-b011-6a6a53df9df4 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b" status: 404 len: 111 microversion: 2.1 time: 0.030905 May 12 15:40:20.595344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 237/460] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:20 2022] GET /compute/v2.1/servers/af588d39-4bcd-46c2-85fa-1c742b2daf8b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:40:20.599696 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:20.610851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:20.612365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:20.613624 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e0d31af4-23ca-4755-b36a-8e23acf3a855 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.243175 May 12 15:40:20.614261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 224/461] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:20 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:21.505404 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:21.506094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:21.513215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:21.513673 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:21.514445 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:21.514883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:21.631524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:21.632104 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:21.638755 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:21.639239 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:21.640011 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:21.640442 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:21.646011 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:21.653536 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-59b6f868-a305-46b0-a8cc-014b046c5469 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.152035 May 12 15:40:21.654011 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 238/462] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:21 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:21.774321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:21.784034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:21.785597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:21.786756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7279275a-1758-469d-8bde-2e2e89aad215 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.159174 May 12 15:40:21.787359 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 225/463] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:21 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:22.674777 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:22.675782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:22.686696 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:22.687451 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:22.688796 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:22.689528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:22.804674 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:22.805495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:22.812124 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:22.812622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:22.813404 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:22.813876 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:22.835128 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:22.843041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-01de6b77-f302-4f46-9441-7675c9ddb5d0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.175117 May 12 15:40:22.843702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 239/464] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:22 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:22.943048 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:22.952246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:22.953983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:22.955268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c3f1ffcb-ae7b-4a41-a8a6-62d7506d18ab tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.154506 May 12 15:40:22.955894 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 226/465] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:22 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:23.864200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:23.864964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:23.871710 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:23.872159 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:23.872976 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:23.873416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:23.973295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:23.973902 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:23.980527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:23.981007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:23.981781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:23.982418 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:24.007454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:24.015116 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-23ed2f5f-a01b-4a42-b564-5d560e9047c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1370 microversion: 2.1 time: 0.157267 May 12 15:40:24.015694 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 240/466] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:23 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:24.111064 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:24.120122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:24.121663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:24.122818 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-89088383-bf5b-45a8-aa9d-c2186a9527b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.153568 May 12 15:40:24.123389 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 227/467] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:23 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:25.023906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:40:25.024373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:40:25.039212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:25.040301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:25.051799 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:25.052463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:25.053940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:25.054548 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:25.143037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:25.144269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:25.153910 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:25.154651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:25.155737 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:25.156980 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:25.336158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:25.348363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fada2281-4a9f-42e9-bc8e-5b819513b1f0 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1565 microversion: 2.1 time: 0.319826 May 12 15:40:25.350533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 241/468] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:25 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1565 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:25.369891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:25.371799 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:25.379516 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:25.380318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:25.382094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:25.382713 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:25.392490 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:25.405299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:25.407377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:25.408833 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4d0d36e2-6674-4425-8d16-1b953042a0f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.271883 May 12 15:40:25.420433 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 228/469] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:25 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:25.489360 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2810a4a9-331c-458a-bdc0-d2557531f53c tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124660 May 12 15:40:25.489981 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 242/470] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:40:25 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:25.800142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1299398909", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1369134100", "security_groups": [{"name": "tempest-secgroup-smoke-501390466"}], "networks": [{"uuid": "5c4759a0-040d-4ab6-a81b-bad646940f2a"}], "block_device_mapping_v2": [{"uuid": "3f5dbd5d-f22d-417c-a832-df4944538c17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:26.427964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:26.429377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:26.441457 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:26.442343 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:26.443332 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:26.445493 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:26.684417 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] validate_networks() for [('5c4759a0-040d-4ab6-a81b-bad646940f2a', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:40:26.903794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:26.923020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:26.925156 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:26.926853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-63bec9e7-7a74-4c3a-bf5b-2ac8d4dcfcd7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.503509 May 12 15:40:26.927956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 243/471] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:26 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:27.686942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:40:27.687429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:40:27.687887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:40:27.688330 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:40:27.688798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:40:27.704077 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:27.704961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:27.711402 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:27.712116 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:27.748869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Getting quotas for project e085f63cf59c49a2847cbf228d7e609c. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:40:27.753328 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Getting quotas for user a61ad9366b5845b5bbf8e8e1fdb649e6 and project e085f63cf59c49a2847cbf228d7e609c. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:40:27.864794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-1709df18-86ca-4cfa-bdd7-0697db613d4a req-61f39341-902b-4aa3-81a2-d2ee5fc89855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa53a7ea-5acc-4021-ac22-69d92ef87b71", "tag": "5ece189e-0f97-4933-9eeb-db6e18b9f97b"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:27.882173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1709df18-86ca-4cfa-bdd7-0697db613d4a req-61f39341-902b-4aa3-81a2-d2ee5fc89855 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:27.882863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1709df18-86ca-4cfa-bdd7-0697db613d4a req-61f39341-902b-4aa3-81a2-d2ee5fc89855 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:27.898319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-1709df18-86ca-4cfa-bdd7-0697db613d4a req-61f39341-902b-4aa3-81a2-d2ee5fc89855 service nova] Creating event network-changed:5ece189e-0f97-4933-9eeb-db6e18b9f97b for instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 on hv-cinder-83588 May 12 15:40:27.907819 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:40:27.910192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f5dbd5d-f22d-417c-a832-df4944538c17',volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:40:27.919288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-1709df18-86ca-4cfa-bdd7-0697db613d4a req-61f39341-902b-4aa3-81a2-d2ee5fc89855 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058252 May 12 15:40:27.920652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 244/472] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:40:27.973565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:27.974258 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:28.030839 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:28.031299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:28.032106 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:28.032585 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:28.271483 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:28.284499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:28.297452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:28.298977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-24caf372-bf3f-4ff7-ac25-b6c5da98de2f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.330564 May 12 15:40:28.307815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 245/473] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:27 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:28.308058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-dbf24a43-396a-41b4-ba59-3b55ac57d32e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.506596 May 12 15:40:28.308058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 229/474] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:40:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:40:28.317336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9a8c7d14-ea80-40c1-bd73-8210385e3ef1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:28.317973 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9a8c7d14-ea80-40c1-bd73-8210385e3ef1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:28.386851 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9a8c7d14-ea80-40c1-bd73-8210385e3ef1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:28.402083 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9a8c7d14-ea80-40c1-bd73-8210385e3ef1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1089 microversion: 2.1 time: 0.091885 May 12 15:40:28.410524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 246/475] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:28 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1089 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:29.323490 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:29.325108 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:29.333068 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:29.333822 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:29.335006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:29.335527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:29.419745 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:29.421141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:29.428333 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:29.429091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:29.430075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:29.430700 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:29.521545 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:29.524307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:29.535897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:29.536233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-91051cd5-bcad-4237-9f59-50e22d0b0c5f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1139 microversion: 2.1 time: 0.119882 May 12 15:40:29.536975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 247/476] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:29 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1139 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:29.548118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:29.548118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-39c26019-9d96-47e7-8a5e-0dbcee1148bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.219413 May 12 15:40:29.548118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 230/477] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:29 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:30.398779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:30.400358 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:30.414996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:30.415754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:30.416844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:30.417486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:30.556515 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:30.557845 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:30.580563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:30.586166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:30.587218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:30.587835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:30.645074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lazy-loading 'services' on Instance uuid be73f585-3978-4a35-b794-ccafc28dd120 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:40:30.697233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:30.707108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d35183d5-cb4c-410f-b337-dc2ee5c76d86 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1139 microversion: 2.1 time: 0.155067 May 12 15:40:30.717146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 248/478] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:30 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1139 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:30.722846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:30.723663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:30.732973 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:30.733686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:30.735292 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:30.735898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:30.938780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3227b084-aa03-4606-928e-74ac58a31035 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-volume_attachments/e85dc85b-0ce5-4492-86b8-57229c4ae167" status: 202 len: 0 microversion: 2.1 time: 0.542919 May 12 15:40:30.941177 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 231/479] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:40:30 2022] DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-volume_attachments/e85dc85b-0ce5-4492-86b8-57229c4ae167 => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:40:30.981252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-706267832", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "networks": [{"uuid": "144446a1-8b69-4758-9c58-572c887f90d4"}]}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:31.090967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:31.103649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:31.108720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:31.109995 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-08a54bae-7760-48a9-a7e9-6e87fafce0e1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.391591 May 12 15:40:31.119434 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 249/480] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:30 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:31.723604 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:31.724454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:31.731419 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:31.731878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:31.732698 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:31.733330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:31.826893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:31.838394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bdcede55-5b74-4002-a670-a5c4a70a0a1e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.118841 May 12 15:40:31.851650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 250/481] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:31 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:32.138626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:32.139528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:32.148602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:32.169469 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:32.172007 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:32.173107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:32.356281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:32.376490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:32.379371 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:32.382055 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-754adc28-8382-4ec5-9ae0-d10e626be149 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.247503 May 12 15:40:32.383250 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 251/482] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:32 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:32.856097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:32.857007 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:32.869465 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:32.873044 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:32.874146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:32.874677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:32.970697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:32.979882 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-818e859b-20d9-4de1-9d7a-d4f950252c24 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.127889 May 12 15:40:32.981009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 252/483] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:32 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:33.404416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:33.405614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:33.412692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:33.413495 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:33.414451 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:33.415212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:33.607084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:33.624846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:33.626340 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:33.632077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e56001bb-5a7b-4425-be7f-6af14510d4e5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.227161 May 12 15:40:33.638580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 253/484] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:33 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:33.997853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:33.998563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:34.009293 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:34.009763 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:34.010572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:34.011010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:34.131964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:34.142180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-600aa65e-59ac-4e3d-a287-940a257a4043 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.148724 May 12 15:40:34.143561 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 254/485] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:33 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:34.648036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:34.648691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:34.657773 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:34.658607 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:34.659880 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:34.660569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:34.889445 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:34.897457 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:34.899146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:34.900425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a0107602-455e-44aa-af18-6437c595676b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.258269 May 12 15:40:34.912951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 255/486] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:34 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:35.163155 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:35.163862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:35.171553 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:35.172006 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:35.172807 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:35.173243 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:35.273245 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:35.290564 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1b747eb7-0287-467b-9b7e-72c0dac0d79e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.132269 May 12 15:40:35.303605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 256/487] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:35 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:35.920291 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:35.920963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:35.927926 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:35.928515 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:35.929444 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:35.929886 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:36.118606 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:36.134319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:36.138307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:36.139534 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a8283f34-a7c9-43e5-bc33-9d54a8a27b57 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.223748 May 12 15:40:36.140430 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 257/488] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:35 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:36.309693 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:36.310582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:36.328570 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:36.329138 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:36.330089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:36.330579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:36.457961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:36.473397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e59f47af-aab7-41c5-be9c-a28c79fdb00f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.167486 May 12 15:40:36.474122 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 258/489] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:36 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:37.158707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:37.159724 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:37.167804 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:37.172382 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:37.173474 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:37.174123 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:37.390685 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:37.403527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:37.405423 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:37.407968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e220f422-0b17-478c-9174-de1c26001030 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.253113 May 12 15:40:37.408979 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 259/490] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:37 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:37.490931 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:37.491929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:37.508356 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:37.511112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:37.512118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:37.521186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:37.632426 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:37.653699 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0ce4f8e8-79f1-4fa7-8f25-2a4108ec3c21 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.166342 May 12 15:40:37.654477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 260/491] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:37 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:38.124939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] validate_networks() for [('144446a1-8b69-4758-9c58-572c887f90d4', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:40:38.434386 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:38.435740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:38.443035 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:38.444266 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:38.445328 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:38.445977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:38.495450 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:40:38.495779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:40:38.496245 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:40:38.496707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:40:38.499148 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:40:38.508531 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:38.509014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:38.510017 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:38.510369 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:38.529734 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Getting quotas for project 24ad1bfe4f634a188dd1613c630f0bbd. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:40:38.534059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Getting quotas for user 1867e3f3c9ad42de8fa552c1c39f0fcd and project 24ad1bfe4f634a188dd1613c630f0bbd. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:40:38.547277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:40:38.549727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:40:38.623863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-de6a289d-b3aa-4046-9513-8db3999dedab tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.679823 May 12 15:40:38.629339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 232/492] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 7682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:40:38.634463 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7864aac9-c3d1-46cd-8cde-4f110f6f27df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:38.635847 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7864aac9-c3d1-46cd-8cde-4f110f6f27df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:38.738798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7864aac9-c3d1-46cd-8cde-4f110f6f27df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:38.751744 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7864aac9-c3d1-46cd-8cde-4f110f6f27df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1218 microversion: 2.1 time: 0.120280 May 12 15:40:38.752596 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 233/493] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:38 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:38.766216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:38.775684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:38.777374 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:38.778758 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:38.779780 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:38.781181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f9d872f3-2efd-48c9-aed3-4da6d6c7edfd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.351415 May 12 15:40:38.781898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 261/494] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:38 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:38.791354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:38.792029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:38.793616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:38.794054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:38.876087 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:38.888642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0d90b846-4a2b-4b73-bf71-c38351055562 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1187 microversion: 2.1 time: 0.123605 May 12 15:40:38.898042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 234/495] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:38 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:39.771057 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:39.772656 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:39.796319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:39.797077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:39.801133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:39.802112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:39.806411 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:39.807685 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:39.820870 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:39.821548 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:39.824507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:39.825177 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:39.936273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:39.944235 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ff2280d5-c347-4f6a-82d5-666518713ab6 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1222 microversion: 2.1 time: 0.179093 May 12 15:40:39.944872 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 262/496] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:39 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:39.955209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:39.956083 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:39.966851 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:39.967623 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:39.968576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:39.969019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:40.190396 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:40.199192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-76f423b0-2f0a-4707-92e4-bfcf276239cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1195 microversion: 2.1 time: 0.253273 May 12 15:40:40.201601 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 263/497] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:39 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1195 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:40.308510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:40.318333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:40.319932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:40.321182 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7e423ee2-3405-48a0-8882-9bdd5a589756 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.519151 May 12 15:40:40.322686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 235/498] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:39 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:40.918754 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2d26c1c9-f18d-4862-bfa1-bbc78faddeda tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:40.982570 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d26c1c9-f18d-4862-bfa1-bbc78faddeda tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:40.984574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d26c1c9-f18d-4862-bfa1-bbc78faddeda tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:40.987859 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:40.989042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:41.011500 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.012223 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.014201 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.015060 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.051488 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2d26c1c9-f18d-4862-bfa1-bbc78faddeda tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Going to try to stop instance {{(pid=123632) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 15:40:41.140722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2d26c1c9-f18d-4862-bfa1-bbc78faddeda tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action" status: 202 len: 0 microversion: 2.1 time: 0.225962 May 12 15:40:41.151150 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:41.154988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 264/499] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:40:40 2022] POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:40:41.159604 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-521f99c1-f9cd-450a-875f-b16dd3921b10 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1276 microversion: 2.1 time: 0.178652 May 12 15:40:41.163019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 236/500] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:40 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:41.167032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:41.168030 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:41.181650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.185455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.187630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.188209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.217975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:41.218588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:41.228765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.229827 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.231425 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.232028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.396202 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:41.404636 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b132a0c2-2f7f-4cd5-94bf-25035dd589af tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1205 microversion: 2.1 time: 0.190583 May 12 15:40:41.405540 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 237/501] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:41 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1205 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:41.410456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:41.411225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:41.417612 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.418594 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.419582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:41.420019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:41.513406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:41.521280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c4483571-1ec7-4eba-b707-c06b4f57fb42 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.364729 May 12 15:40:41.521869 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 265/502] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:41 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:41.606710 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:41.615595 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:41.617163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:41.618288 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-075bd202-5910-4375-b804-e2f7235ba797 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.211643 May 12 15:40:41.618855 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 238/503] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:41 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:42.177022 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:42.177629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:42.184592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.185266 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.186096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.186895 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.421890 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:42.422508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:42.435419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.436042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.436892 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.437572 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.454519 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:42.465052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8ffed039-8023-4aa6-99da-b811056f141c tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.292024 May 12 15:40:42.469472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 266/504] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:42 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:42.538858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:42.539467 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:42.548066 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.548785 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.550842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.551424 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.827053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:42.838979 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-43944a3f-9669-4062-839f-f09c3d257033 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.420948 May 12 15:40:42.851153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 239/505] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:42 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:42.856848 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-d1b9f3dd-6025-43be-80b2-d34198e22ede req-d7f354da-fa05-4b1d-9501-0eeb0d610ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8a08c7-6de8-4d93-b8d3-e62cd2faba36", "tag": "9e1db9d6-3d4d-43d2-87ce-d656bfaae82b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:42.865968 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-d1b9f3dd-6025-43be-80b2-d34198e22ede req-d7f354da-fa05-4b1d-9501-0eeb0d610ae6 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.866912 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-d1b9f3dd-6025-43be-80b2-d34198e22ede req-d7f354da-fa05-4b1d-9501-0eeb0d610ae6 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.884975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-d1b9f3dd-6025-43be-80b2-d34198e22ede req-d7f354da-fa05-4b1d-9501-0eeb0d610ae6 service nova] Creating event network-changed:9e1db9d6-3d4d-43d2-87ce-d656bfaae82b for instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 on hv-cinder-83588 May 12 15:40:42.891076 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-d1b9f3dd-6025-43be-80b2-d34198e22ede req-d7f354da-fa05-4b1d-9501-0eeb0d610ae6 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 May 12 15:40:42.892279 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 240/506] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:42.899831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:42.900947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:42.908512 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.909216 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.910855 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.911773 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:42.925627 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:42.942463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-40859590-4676-487f-8ade-cb63d30f9e58 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.407297 May 12 15:40:42.943005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 267/507] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:42 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:42.961342 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-38d1ac25-1eb2-4911-be87-ef0893e6ddcf req-72f06df5-46c4-4c4f-9de9-a5c8f71f243c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:42.974540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-38d1ac25-1eb2-4911-be87-ef0893e6ddcf req-72f06df5-46c4-4c4f-9de9-a5c8f71f243c service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:42.975082 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-38d1ac25-1eb2-4911-be87-ef0893e6ddcf req-72f06df5-46c4-4c4f-9de9-a5c8f71f243c service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:43.018643 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-38d1ac25-1eb2-4911-be87-ef0893e6ddcf req-72f06df5-46c4-4c4f-9de9-a5c8f71f243c service nova] Creating event network-changed:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:40:43.032454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-38d1ac25-1eb2-4911-be87-ef0893e6ddcf req-72f06df5-46c4-4c4f-9de9-a5c8f71f243c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086967 May 12 15:40:43.035702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 268/508] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:43.153459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:43.162866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:43.164315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:43.165510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0167d703-050c-401b-9995-3e19ad44f4aa tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.271925 May 12 15:40:43.166057 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 241/509] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:42 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:43.489038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:43.489657 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:43.497475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:43.497928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:43.498741 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:43.499184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:43.668059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:43.676183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bc62eaed-4fc1-4a2d-b204-86344aaacc74 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.193167 May 12 15:40:43.676784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 269/510] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:43 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:43.860204 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:43.861269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:43.872365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:43.873217 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:43.874492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:43.875262 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:43.961385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:43.962069 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:43.968371 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:43.968841 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:43.969613 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:43.970048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:44.018364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:44.026266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-98ead05e-f1a5-4034-a043-27d65b7fca1d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.172382 May 12 15:40:44.026951 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 242/511] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:43 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:44.102735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:44.110390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f88a8ea2-7319-4a16-9aac-4fabc7eb4ab9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.153653 May 12 15:40:44.110887 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 270/512] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:43 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:44.184639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:44.185301 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:44.191321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:44.191778 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:44.192580 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:44.193017 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:44.377894 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:44.386815 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:44.388332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:44.389539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f6b16f76-6576-488c-a1e2-8104faa5f6b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.209169 May 12 15:40:44.390319 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 243/513] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:44 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:44.693577 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:44.694365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:44.700569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:44.701099 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:44.701960 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:44.702481 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.043769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:45.044386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:45.050929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:45.051362 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.052331 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:45.052929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.240832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:45.252621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-860a4f87-16aa-4e6d-a1f8-4a7e72d5ff3d tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.563396 May 12 15:40:45.253267 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 271/514] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:44 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:45.263398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:45.264002 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:45.269442 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:45.270371 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:45.270822 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.271646 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:45.272081 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.278101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-96ade701-9334-495f-a84a-f415e3065c79 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.238416 May 12 15:40:45.278882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 244/515] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:45 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:45.406255 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:45.407217 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:45.407893 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:45.414074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:45.414454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c3c6900a-f202-40a9-ac4e-cc2efddd267f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.159771 May 12 15:40:45.414611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.424515 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 272/516] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:45 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:45.424932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:45.424932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:45.549121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:45.557865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:45.559345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:45.560498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-505ce188-e2b3-4f96-9074-49d14203bc14 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.157337 May 12 15:40:45.561263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 245/517] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:45 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:46.270100 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:46.270828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:46.277482 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.277937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.278707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.279145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.296583 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:46.297576 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:46.315225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.315822 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.316700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.317437 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.472767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:46.480010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fcac5e15-9254-4a9d-97cd-3a50c0da30fd tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.214032 May 12 15:40:46.480593 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 273/518] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:46 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:46.494890 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:46.495492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:46.501697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.502145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.503082 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.503693 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.512767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:46.520722 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e3661c03-b9ce-4536-8256-c8ddabb9e7e0 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.229518 May 12 15:40:46.521542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 246/519] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:46 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:46.579155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:46.579767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:46.587294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.588652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.589680 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:46.590304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:46.820688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:46.829118 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9c8ee2b1-706e-4e07-a09a-5c5b9bca5ea6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.338172 May 12 15:40:46.839821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 274/520] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:46 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:46.870144 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:46.880146 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:46.881859 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:46.883092 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c513796c-a436-47d0-8cf6-3c180d0c7d0d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.308203 May 12 15:40:46.883660 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 247/521] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:46 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:47.498429 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:47.499657 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:47.512651 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.513325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.514498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.515100 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.538513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:47.541858 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:47.549326 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.550091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.551073 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.551686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.734488 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:47.743008 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e74c832d-a5a9-44d9-bc76-05b7f2aa1a93 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.249078 May 12 15:40:47.743862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 275/522] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:47 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:47.759946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:47.767356 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d40ec667-fd7f-4e00-9102-4a4afe7262ce tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.232773 May 12 15:40:47.767954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 248/523] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:47 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:47.846694 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:47.847367 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:47.853720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.854181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.854919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.855347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.902354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:47.902992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:47.909102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.909649 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:47.910551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:47.911061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:48.036644 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:48.044730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fafea2d7-e902-408f-8ccf-d6569824481d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.201955 May 12 15:40:48.045307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 276/524] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:47 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:48.078560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:48.087037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:48.088551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:48.089708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1a9bf279-3bb3-414d-888e-8893b9a4e300 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.191489 May 12 15:40:48.090294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 249/525] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:47 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:48.764193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:48.765307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:48.773735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:48.774188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:48.774967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:48.775408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:48.783136 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:48.783856 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:48.790677 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:48.791057 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:48.791830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:48.792263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:48.965033 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:48.972931 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c36c321b-6e75-4ca2-b5b2-e059862bc8b0 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.214752 May 12 15:40:48.973572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 277/526] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:48 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:48.979338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:48.987359 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8863b7aa-dbb8-4507-9dc2-8a6cea667f93 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.208089 May 12 15:40:48.988008 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 250/527] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:48 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:49.066150 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:49.066797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:49.074235 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:49.074736 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:49.075587 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:49.076071 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:49.108436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:49.109078 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:49.115541 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:49.116000 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:49.116815 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:49.117257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:49.256517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:49.264279 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6303abc7-e05d-4c34-8e1e-7c2e49199f0e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.204640 May 12 15:40:49.264894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 278/528] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:49 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:49.283032 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:49.291916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:49.293799 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:49.294956 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1480bd0e-03b4-4445-892a-5ccb7004f786 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.190432 May 12 15:40:49.295525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 251/529] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:49 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:49.990061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:49.990616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:49.997547 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:49.997966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:49.998779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:49.999216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.003315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:50.004054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:50.010899 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:50.011351 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.012113 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:50.012556 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.191108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:50.199253 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c19e33d0-4fbb-4241-bf1b-e74328ecc9df tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.213241 May 12 15:40:50.199652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:50.200210 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 279/530] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:49 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:50.207394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3ef439b4-a0d2-4ed8-8406-2b6d21361137 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.208016 May 12 15:40:50.207922 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 252/531] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:49 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:50.284645 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:50.285693 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:50.296370 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:50.297179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.298445 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:50.299179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.313429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:50.314058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:50.320512 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:50.320991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.321751 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:50.322177 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:50.479493 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:50.488031 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c97eccde-aa8f-4917-a8a6-374d5849bdfe tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.209749 May 12 15:40:50.488626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 280/532] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:50 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:50.505254 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:50.514912 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:50.517320 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:50.519299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8425e94a-00c9-47aa-a549-2ed6ca969246 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.209225 May 12 15:40:50.520086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 253/533] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:50 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:51.215989 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:51.216614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:51.223300 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.223750 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.224237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:51.224726 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.224909 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:51.225114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.231532 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.231978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.232858 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.233271 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.420237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:51.425032 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:51.428274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f34a3ad1-33cb-425c-9f01-d20b52697a7a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.216187 May 12 15:40:51.428972 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 281/534] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:51 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:51.432925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d866a11c-3ba9-4bb1-87ca-20d3a95b6845 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.212571 May 12 15:40:51.433452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 254/535] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:51 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:51.507571 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:51.508173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:51.514885 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.515344 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.516149 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.516663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.538934 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:51.539539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:51.546265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.546701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.547457 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:51.547886 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:51.709612 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:51.717087 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-23828187-aa6c-4582-960e-5a42c5b5b502 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.214063 May 12 15:40:51.717652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 282/536] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:51 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:51.721988 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:51.730765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:51.732252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:51.733432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b4f253bc-7aac-4fb1-b540-73d8e74fb3f5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.198489 May 12 15:40:51.734241 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 255/537] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:51 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:52.102963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-96ff37eb-388e-4b4c-97ad-efd72c61283f req-81180c59-4c19-49dc-b82e-7d49fce729ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "name": "network-vif-plugged", "status": "completed", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:52.111425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-96ff37eb-388e-4b4c-97ad-efd72c61283f req-81180c59-4c19-49dc-b82e-7d49fce729ee service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.111964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-96ff37eb-388e-4b4c-97ad-efd72c61283f req-81180c59-4c19-49dc-b82e-7d49fce729ee service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.123473 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-96ff37eb-388e-4b4c-97ad-efd72c61283f req-81180c59-4c19-49dc-b82e-7d49fce729ee service nova] Creating event network-vif-plugged:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:40:52.128657 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-96ff37eb-388e-4b4c-97ad-efd72c61283f req-81180c59-4c19-49dc-b82e-7d49fce729ee service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029444 May 12 15:40:52.129416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 283/538] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:52.445746 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:52.447390 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:52.450412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:52.451831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:52.456665 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.457196 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.458085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.458579 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.460537 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.461198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.462208 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.462848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.654175 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:52.657615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:52.662038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-65d35491-9153-4581-8ffd-cb96e438ce22 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.221468 May 12 15:40:52.662652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 256/539] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:52 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:52.665596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0d71dcd8-d277-4c89-8e25-78ec83c0c326 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.219330 May 12 15:40:52.666176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 284/540] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:52 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:52.738064 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:52.739105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:52.749766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.750506 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.751753 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.752507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.754440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:52.755052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:52.761620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.762070 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.762844 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:52.763278 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:52.944452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:52.948151 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:52.954145 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e84bd363-fc06-4d78-92da-f2ea074a8df3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.222236 May 12 15:40:52.958103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:52.959738 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:52.961321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fdb57020-ffeb-446f-ac3c-3295a2368db5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.212910 May 12 15:40:52.962792 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 285/541] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:52 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:52.964865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 257/542] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:52 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:53.681511 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:53.682239 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:53.683721 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:53.684350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:53.689899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.690470 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.691361 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.691805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.691966 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.692267 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.693077 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.693514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.896613 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:53.901357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:53.904626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a8d10ac4-ce09-4b63-9fed-959cd5d31dcf tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.227829 May 12 15:40:53.905181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 286/543] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:53 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:53.908952 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d5c5f112-9d5b-4226-a496-d6e677bc89d5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1260 microversion: 2.1 time: 0.230080 May 12 15:40:53.909591 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 258/544] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:53 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:53.973953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:53.974576 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:53.980623 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:53.981314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.981459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:53.981802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.982579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.983015 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.987640 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.988210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:53.989048 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:53.989480 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:54.185351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:54.190419 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:54.192963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ffbc064b-808c-4d2c-81c3-03d61a9dc156 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.224496 May 12 15:40:54.193739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 287/545] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:53 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:54.198121 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-4f978020-78eb-44ea-abe2-9bb681d644ad req-7abf3795-9f81-4f03-bedd-3ace06822668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8a08c7-6de8-4d93-b8d3-e62cd2faba36", "name": "network-vif-plugged", "status": "completed", "tag": "9e1db9d6-3d4d-43d2-87ce-d656bfaae82b"}, {"server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "name": "network-vif-plugged", "status": "completed", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:54.204953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:54.206782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:54.207015 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4f978020-78eb-44ea-abe2-9bb681d644ad req-7abf3795-9f81-4f03-bedd-3ace06822668 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:54.207617 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4f978020-78eb-44ea-abe2-9bb681d644ad req-7abf3795-9f81-4f03-bedd-3ace06822668 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:54.208294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d7cea737-507d-41e6-adb6-ac39e1d6de76 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.231593 May 12 15:40:54.212538 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 259/546] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:53 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:54.221995 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-4f978020-78eb-44ea-abe2-9bb681d644ad req-7abf3795-9f81-4f03-bedd-3ace06822668 service nova] Creating event network-vif-plugged:9e1db9d6-3d4d-43d2-87ce-d656bfaae82b for instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 on hv-cinder-83588 May 12 15:40:54.222584 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-4f978020-78eb-44ea-abe2-9bb681d644ad req-7abf3795-9f81-4f03-bedd-3ace06822668 service nova] Creating event network-vif-plugged:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:40:54.228778 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-4f978020-78eb-44ea-abe2-9bb681d644ad req-7abf3795-9f81-4f03-bedd-3ace06822668 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034062 May 12 15:40:54.229363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 288/547] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:54.931492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:54.931492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:54.932059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:54.932059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:54.935641 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:54.937609 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:54.938018 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:54.938476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:54.939434 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:54.939870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:54.940195 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:54.940854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.140335 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.144461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.147992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0d01d49b-40d6-46ae-87b7-0cf100ce8702 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.230232 May 12 15:40:55.148752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 260/548] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:54 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:55.152644 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9c8f1ddf-c8d5-42a6-83da-f9e2ec950df5 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1443 microversion: 2.1 time: 0.227157 May 12 15:40:55.155942 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 289/549] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:54 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1443 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:55.170124 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:55.170754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:55.177393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:55.178239 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.179418 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:55.179851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.210956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:55.211742 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:55.221001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:55.221453 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.222331 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:55.222766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.362539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.370453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-828a3940-3da6-476f-9299-e6201fd3ef68 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1443 microversion: 2.1 time: 0.204820 May 12 15:40:55.371246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 261/550] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:55 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1443 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:55.375519 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:55.376150 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:55.382091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:55.382572 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.383305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:55.383733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:55.393356 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.401808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c0781472-2678-4c5a-84ba-1c6fac4eceb4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.194828 May 12 15:40:55.402612 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 290/551] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:55 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:55.516782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.525376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.526950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:55.528329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2ce0732a-9a78-442e-a920-c7f4490552b1 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.156375 May 12 15:40:55.529203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 262/552] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:55 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:56.169038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:56.169745 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:56.177747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:56.178323 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:56.179091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:56.179530 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:56.311725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:56.319183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-979ab963-defb-4a72-9595-92c87be0a13b tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1318 microversion: 2.1 time: 0.156788 May 12 15:40:56.319750 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 291/553] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:56 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:56.422090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:56.422847 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:56.432672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:56.433248 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:56.434462 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:56.435143 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:56.547225 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:56.548086 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:56.554772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:56.555195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:56.556220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:56.556697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:56.581973 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:56.589938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-31034299-585a-4fd5-bc7a-9a3f20beb7c3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1679 microversion: 2.1 time: 0.174319 May 12 15:40:56.590523 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 263/554] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:56 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:56.687607 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:56.696133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:56.697648 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:56.698791 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9e46d716-ae93-4be0-8852-831d21c123c9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1805 microversion: 2.20 time: 0.155978 May 12 15:40:56.699521 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 292/555] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:56 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:40:57.334944 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:57.335549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:57.342551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.343028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.343932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.344361 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.498925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-7e2428ba-91ae-481e-83d8-0dba6eece8d0 req-8a1fcd7d-4fdd-4312-8952-1dafc5c77128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:57.513980 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-7e2428ba-91ae-481e-83d8-0dba6eece8d0 req-8a1fcd7d-4fdd-4312-8952-1dafc5c77128 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.514655 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-7e2428ba-91ae-481e-83d8-0dba6eece8d0 req-8a1fcd7d-4fdd-4312-8952-1dafc5c77128 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.524796 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:57.536730 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-46ff0248-b566-4785-aaff-6061070e475a tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1507 microversion: 2.1 time: 0.205406 May 12 15:40:57.537974 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 264/556] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:57 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:57.539126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-7e2428ba-91ae-481e-83d8-0dba6eece8d0 req-8a1fcd7d-4fdd-4312-8952-1dafc5c77128 service nova] Creating event network-changed:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:40:57.544904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-7e2428ba-91ae-481e-83d8-0dba6eece8d0 req-8a1fcd7d-4fdd-4312-8952-1dafc5c77128 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050222 May 12 15:40:57.545945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 293/557] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:40:57.554151 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "600c2157-d3f2-492c-a300-a27fa1f74678", "device": "/dev/sdb"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:57.556046 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:57.562779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.563588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.564754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.565335 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.607232 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:57.607908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:57.628813 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.629438 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.631184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.632961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.810484 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:57.820520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a560552d-67d9-4fdf-a0f4-f747fff47d88 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1656 microversion: 2.1 time: 0.217044 May 12 15:40:57.833984 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 294/558] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:57 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1656 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:40:57.840394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:57.841033 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:57.848365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.849347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.850141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.850667 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:57.943096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-aeb6855f-f833-4b89-9794-4c3fd3ac4eec tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "POST /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393083 May 12 15:40:57.944697 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 265/559] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:40:57 2022] POST /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:40:57.951275 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-263228ce-6171-450d-9f94-d991a7d4321e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:40:57.959333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-263228ce-6171-450d-9f94-d991a7d4321e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:57.960394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-263228ce-6171-450d-9f94-d991a7d4321e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:58.045942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-263228ce-6171-450d-9f94-d991a7d4321e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Going to try to start instance {{(pid=123633) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 15:40:58.110372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:58.124277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:58.126065 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-263228ce-6171-450d-9f94-d991a7d4321e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action" status: 202 len: 0 microversion: 2.1 time: 0.179706 May 12 15:40:58.127963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:58.128837 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 266/560] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:40:57 2022] POST /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:40:58.133652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b8433a02-ad54-4b3b-ade0-553169157c48 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1792 microversion: 2.20 time: 0.298238 May 12 15:40:58.134728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 295/561] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:40:57 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1792 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:40:58.147216 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:58.147216 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:58.154898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:58.155774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:58.156872 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:58.157563 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:58.343102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:58.350905 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9b1f1888-d35a-4544-96ed-9dcdf9f9bca7 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1665 microversion: 2.1 time: 0.217010 May 12 15:40:58.351491 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 267/562] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:58 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1665 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:40:59.372959 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:40:59.373846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:40:59.384814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:59.385569 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:59.386839 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:40:59.387548 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:40:59.531066 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:40:59.538755 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e998034a-2e1c-41f1-8d7c-fbec67cc222f tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1665 microversion: 2.1 time: 0.172460 May 12 15:40:59.539325 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 296/563] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:40:59 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1665 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:00.558911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:00.559511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:00.566361 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:00.566818 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:00.567586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:00.568022 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:00.700169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:00.707707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2746730b-6f29-4c59-b08e-670937bb8e2a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1669 microversion: 2.1 time: 0.154066 May 12 15:41:00.708270 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 268/564] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:00 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:15.543857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91173c6d-fa3c-4d67-903e-df8f10c9acaf"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:15.544933 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:15.551080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:15.551529 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:15.552287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:15.552753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:15.813207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1179c2d2-b163-401a-90eb-21f701477988 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273723 May 12 15:41:15.813917 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 297/565] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:41:15 2022] POST /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:17.462089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:17.462619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:17.469467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:17.469853 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:17.470619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:17.471052 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:17.550884 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lazy-loading 'services' on Instance uuid 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:41:17.625547 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9913a5a8-5d10-400e-8e75-363d7a33fca9 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "DELETE /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36/os-volume_attachments/600c2157-d3f2-492c-a300-a27fa1f74678" status: 202 len: 0 microversion: 2.1 time: 0.167262 May 12 15:41:17.626158 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 269/566] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:41:17 2022] DELETE /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36/os-volume_attachments/600c2157-d3f2-492c-a300-a27fa1f74678 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:41:23.360088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:23.361273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:23.368113 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:23.368611 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:23.369383 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:23.369853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:23.393120 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lazy-loading 'flavor' on Instance uuid aa53a7ea-5acc-4021-ac22-69d92ef87b71 {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:41:23.516160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ec341984-2bb2-47e2-8030-1455d1256b9d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/action" status: 200 len: 32 microversion: 2.1 time: 0.160480 May 12 15:41:23.516905 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 298/567] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:41:23 2022] POST /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:41:23.527142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:23.527906 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:23.534424 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:23.534873 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:23.535652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:23.536088 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:23.748881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:23.757211 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e9e9bbff-9ca1-417e-8844-b13da64f98fa tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.234806 May 12 15:41:23.757767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 270/568] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:23 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:24.059641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:24.060228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:24.066533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:24.066986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:24.067763 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:24.068205 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:24.093697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:41:24.174745 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4cd65a9f-55c2-483f-a9c9-5b6e7eefbd04 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "DELETE /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 204 len: 0 microversion: 2.1 time: 0.119582 May 12 15:41:24.175297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 299/569] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:41:24 2022] DELETE /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:41:24.183658 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:24.184266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:24.190349 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:24.190800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:24.191600 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:24.192031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:24.330561 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:24.341951 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5a1081a2-c4d7-4934-a2ff-ee51fae05764 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1513 microversion: 2.1 time: 0.162030 May 12 15:41:24.342672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 271/570] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:24 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:41:24.779856 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:24.783997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:24.794093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:24.794663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:24.795645 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:24.796193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:24.937517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:24.947565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0ab6c180-2516-429e-852a-47aebdaa6423 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.174217 May 12 15:41:24.948014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 300/571] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:24 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:25.363507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:25.364513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:25.375042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:25.375725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:25.377043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:25.377754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:25.518993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:25.528816 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-72e881e3-992e-4a63-aa6c-706e599f0161 tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1513 microversion: 2.1 time: 0.171601 May 12 15:41:25.529412 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 272/572] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:25 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:25.971981 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:25.972868 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:25.982711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:25.983166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:25.983932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:25.984369 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:26.115756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:26.127961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c6b7da17-a608-48a3-b908-c5e4721c709d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.162580 May 12 15:41:26.128821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 301/573] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:25 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:26.546664 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:26.547248 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:26.554775 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:26.555227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:26.556007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:26.556505 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:26.746166 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1867e3f3c9ad42de8fa552c1c39f0fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ad1bfe4f634a188dd1613c630f0bbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:26.754415 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-605eae62-a9e9-4752-9304-8b00afbb4a8f tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 200 len: 1513 microversion: 2.1 time: 0.212191 May 12 15:41:26.755163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 273/574] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:26 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:26.858030 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-8cf297c9-fde9-4c0d-9162-ed798eefe404 req-5a2b5cb6-bda6-442c-b815-aafb0ddb470f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8a08c7-6de8-4d93-b8d3-e62cd2faba36", "name": "network-vif-deleted", "tag": "9e1db9d6-3d4d-43d2-87ce-d656bfaae82b"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:26.866729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8cf297c9-fde9-4c0d-9162-ed798eefe404 req-5a2b5cb6-bda6-442c-b815-aafb0ddb470f service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:26.867179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8cf297c9-fde9-4c0d-9162-ed798eefe404 req-5a2b5cb6-bda6-442c-b815-aafb0ddb470f service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:26.878766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-8cf297c9-fde9-4c0d-9162-ed798eefe404 req-5a2b5cb6-bda6-442c-b815-aafb0ddb470f service nova] Creating event network-vif-deleted:9e1db9d6-3d4d-43d2-87ce-d656bfaae82b for instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 on hv-cinder-83588 May 12 15:41:26.884036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-8cf297c9-fde9-4c0d-9162-ed798eefe404 req-5a2b5cb6-bda6-442c-b815-aafb0ddb470f service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029687 May 12 15:41:26.884920 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 302/575] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:27.152618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:27.153293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:27.160423 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:27.160956 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:27.161803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:27.162290 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:27.296394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:27.308364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-88cd02bb-7555-4906-bde6-63f34e61eacf tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.162017 May 12 15:41:27.309170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 274/576] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:27 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:27.778259 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:27.779053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] [instance: 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:27.786533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:27.787031 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:27.787879 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:27.788357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:27.803650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] HTTP exception thrown: Instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 could not be found. May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Request method failure captured: May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 HTTP/1.1 May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSoJMI7xMIR94diMfbsxEGomuST9Rd3jscrU5rWIUwkPCOHdmqNI5kMkLuGq_7QyH9haLm-bdaSio5Zi94P20xWHMk9qvr8LDyVTnYl9CMo84_F_2IUYT9eZvQXhaIoZ057jYur6ayJt8oFSYud1TyXaH4lCg7ovJ5aRTLz-b-dICIk May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 24ad1bfe4f634a188dd1613c630f0bbd May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1312221365 May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:41:27.805477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_24ad1bfe4f634a188dd1613c630f0bbd", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/24ad1bfe4f634a188dd1613c630f0bbd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/24ad1bfe4f634a188dd1613c630f0bbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/24ad1bfe4f634a188dd1613c630f0bbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesSnapshotTestJSON-1312221365 May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 24ad1bfe4f634a188dd1613c630f0bbd May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1312221365 May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesSnapshotTestJSON-1312221365-project May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 1867e3f3c9ad42de8fa552c1c39f0fcd May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesSnapshotTestJSON-1312221365-project May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 could not be found. May 12 15:41:27.807079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '4a8a08c7-6de8-4d93-b8d3-e62cd2faba36'} May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 could not be found. May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:41:27.808036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 could not be found. May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 could not be found. May 12 15:41:27.809903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:27.811202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] Returning 404 to user: Instance 4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:41:27.811202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d6744c68-95bc-493c-b7be-0ee2be32a3ce tempest-VolumesSnapshotTestJSON-1312221365 tempest-VolumesSnapshotTestJSON-1312221365-project] 10.222.0.89 "GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36" status: 404 len: 111 microversion: 2.1 time: 0.036289 May 12 15:41:27.811202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 303/577] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:27 2022] GET /compute/v2.1/servers/4a8a08c7-6de8-4d93-b8d3-e62cd2faba36 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:41:28.334813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:28.335640 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:28.346467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:28.347281 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:28.348614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:28.349387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:28.486889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:28.494810 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1b2e0817-8a50-46cf-8ef5-387214dfb1e2 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.166675 May 12 15:41:28.495385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 275/578] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:28 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:29.512689 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:29.513459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:29.522963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:29.523527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:29.524527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:29.525082 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:29.663596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:29.673594 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-424d0cca-88ec-4f1e-b751-20e1721f5314 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.165751 May 12 15:41:29.674391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 304/579] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:29 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:30.694997 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:30.695831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:30.703980 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:30.704457 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:30.705235 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:30.705676 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:30.848106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:30.856284 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-72b7559f-7821-4ce2-b55d-e0379505f481 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.167908 May 12 15:41:30.856903 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 276/580] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:30 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:31.878305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:31.879216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:31.888842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:31.889298 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:31.890078 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:31.890517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:32.024149 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:32.032873 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a25c226b-e047-4cb7-a27c-831d15378ff8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.161389 May 12 15:41:32.033452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 305/581] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:31 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:33.050541 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:33.051119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:33.057735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:33.058181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:33.058942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:33.059376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:33.191360 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:33.203710 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-56fb3c03-5276-48e7-8fb5-7958f2c789b4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.156745 May 12 15:41:33.204544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 277/582] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:33 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:34.224650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:34.225487 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:34.233507 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:34.233951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:34.234727 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:34.235160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:34.380461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:34.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ad4a7f45-06c6-4c89-a558-b1bfaf81a071 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.170765 May 12 15:41:34.389885 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 306/583] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:34 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:35.410521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:35.411434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:35.422845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:35.423635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:35.424947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:35.425687 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:35.563293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:35.571804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-674b2954-abf5-45c0-93a5-68c957c5583d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.168068 May 12 15:41:35.572387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 278/584] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:35 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:36.594182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:36.595369 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:36.605938 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:36.606692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:36.607996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:36.608786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:36.752078 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:36.765209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-94b3a233-b3ad-45f2-bc10-06dd95f3ccf3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.177167 May 12 15:41:36.765817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 307/585] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:36 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:37.787193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:37.788230 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:37.798511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:37.798961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:37.799726 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:37.800158 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:37.946136 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:37.955681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6868474a-df34-4ccf-a97f-4c10eb3265eb tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.174748 May 12 15:41:37.956642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 279/586] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:37 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:38.976498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:38.977218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:38.984443 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:38.984994 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:38.985826 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:38.986424 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:39.124831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:39.133626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f218f96d-ee2e-4feb-bd58-4d333e142456 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.161381 May 12 15:41:39.134195 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 308/587] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:38 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:40.154971 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:40.155914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:40.167293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:40.168447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:40.169781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:40.170510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:40.304115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:40.312263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9ee8ff18-f9cf-4719-b18b-f6a571798f73 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.163844 May 12 15:41:40.312878 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 280/588] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:40 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:41.333843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:41.334670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:41.345476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:41.346236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:41.347257 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:41.347688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:41.489559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:41.498218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8e238424-d23e-4e14-9451-220365e92e0f tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.170917 May 12 15:41:41.498791 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 309/589] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:41 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:42.515443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:42.516030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:42.523059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:42.523489 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:42.524263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:42.524768 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:42.664448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:42.673362 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-67682550-3c90-4ab1-a50d-dafeb72822a5 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.161888 May 12 15:41:42.673949 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 281/590] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:42 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:43.691420 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:43.692042 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:43.698793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:43.699240 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:43.700023 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:43.700461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:43.833640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:43.845747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8e497639-6d3e-48ee-8870-f08ebfc15cd4 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1736 microversion: 2.1 time: 0.157948 May 12 15:41:43.846555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 310/591] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:43 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:44.867573 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:44.868143 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:44.877752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:44.878440 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:44.879226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:44.879674 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.018470 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:45.030822 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-19170615-6029-4d7c-b9a9-fce10f72128a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1716 microversion: 2.1 time: 0.169424 May 12 15:41:45.031465 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 282/592] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:44 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:45.156317 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:45.156989 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:45.165523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:45.166052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.166820 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:45.167252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.246839 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] HTTP exception thrown: Cannot 'detach_volume' instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 while it is in vm_state rescued May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Request method failure captured: May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments/91173c6d-fa3c-4d67-903e-df8f10c9acaf HTTP/1.1 May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSnmslxjOw92y13wHry1lWnGADOsl6791JPT6gMnRLwjaADu5UkamgnmBKpOKr6X6iJ1JkGQAbaWm0pk7DkVPavaMt8-cwkw-sMdtcwmgS9L6qzNQyYFnh5Si8OR-0EOLjbRfOvjANcMd5yAPEZm9tunNuyIuvYgKqyAG8Xracq1I8A May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:41:45.248351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72d34bbf298a42fc943c77b2d90747e6", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: eaf5525a857c46ca9000626e60136eb9 May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:41:45.249966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Cannot 'detach_volume' instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 while it is in vm_state rescued May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'server_id': 'aa53a7ea-5acc-4021-ac22-69d92ef87b71', 'id': '91173c6d-fa3c-4d67-903e-df8f10c9acaf'} May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:41:45.250832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 while it is in vm_state rescued May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 while it is in vm_state rescued May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:45.252214 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Returning 409 to user: Cannot 'detach_volume' instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 while it is in vm_state rescued {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:41:45.253532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-78d45134-ea72-40be-a9a1-9662cb64ab67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments/91173c6d-fa3c-4d67-903e-df8f10c9acaf" status: 409 len: 152 microversion: 2.1 time: 0.100059 May 12 15:41:45.253532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 311/593] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:41:45 2022] DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments/91173c6d-fa3c-4d67-903e-df8f10c9acaf => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 15:41:45.261613 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:45.262374 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:45.270767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:45.271230 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.272005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:45.272446 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.345147 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ec21427f-e29c-4eea-8f96-2dddce4b9e4a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "POST /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/action" status: 202 len: 0 microversion: 2.1 time: 0.089528 May 12 15:41:45.345849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 283/594] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:41:45 2022] POST /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 15:41:45.354145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:45.354752 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:45.361568 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:45.362061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.363065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:45.363663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:45.577856 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:45.586017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2ea555fa-fa2f-4aef-8acb-8f5c8e34dc24 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1724 microversion: 2.1 time: 0.235791 May 12 15:41:45.586589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 312/595] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:45 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:46.607776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:46.608517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:46.615286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:46.615738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:46.616499 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:46.616981 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:46.758362 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:46.766392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-abb1f5ad-9305-4ffa-9356-be806fbfa7c3 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1724 microversion: 2.1 time: 0.162871 May 12 15:41:46.766972 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 284/596] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:46 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:47.786237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:47.786981 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:47.796652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:47.797300 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:47.798394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:47.799009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:47.939089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:47.948202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-95739202-2b86-4fd8-9dd3-3ae1b4a8211d tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1724 microversion: 2.1 time: 0.167670 May 12 15:41:47.948825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 313/597] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:47 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:48.966293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:48.966992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:48.973221 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:48.973666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:48.974431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:48.974858 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.101269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:49.109752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0609092c-d9bc-4b3b-afc5-2e7c36fbc821 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1730 microversion: 2.1 time: 0.147847 May 12 15:41:49.110336 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 285/598] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:48 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:49.126748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:49.127290 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:49.134390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:49.134846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.135624 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:49.136091 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.219355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-61dca118-34f5-4f9a-a469-15d97118bf32 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096477 May 12 15:41:49.219996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 314/599] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:41:49 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:49.713048 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:49.713443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:49.721314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:49.721764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.722542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:49.722973 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.752023 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-11fb5b1d-0bb4-4191-b480-7ba74c264b6e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments/beeb439a-3691-46d4-b42c-33c878c7cd20" status: 200 len: 194 microversion: 2.20 time: 0.043186 May 12 15:41:49.752669 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 286/600] 10.222.0.89 () {60 vars in 1453 bytes} [Thu May 12 15:41:49 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments/beeb439a-3691-46d4-b42c-33c878c7cd20 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:41:49.815710 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:49.816197 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:49.822053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:49.822482 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.823233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:49.823673 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:49.904119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lazy-loading 'services' on Instance uuid 0a406a83-d33b-40db-adb0-9789902c45cb {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:41:49.985123 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d25f1aa7-9b25-4d54-884a-ff14e844d290 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments/beeb439a-3691-46d4-b42c-33c878c7cd20" status: 202 len: 0 microversion: 2.20 time: 0.173102 May 12 15:41:49.985740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 315/601] 10.222.0.89 () {60 vars in 1456 bytes} [Thu May 12 15:41:49 2022] DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments/beeb439a-3691-46d4-b42c-33c878c7cd20 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 15:41:49.994429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:49.995562 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:50.002187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.002657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.003443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.003882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.047082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7f586bea-4b81-40fb-be01-4af66b6e8d6c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056578 May 12 15:41:50.047780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 287/602] 10.222.0.89 () {60 vars in 1342 bytes} [Thu May 12 15:41:49 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:41:50.165021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-b25515df-33af-40e7-988d-fa0ba74cc9a1 req-74c82eeb-2b2d-4b1d-9ad8-c03d10f40de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa53a7ea-5acc-4021-ac22-69d92ef87b71", "tag": "5ece189e-0f97-4933-9eeb-db6e18b9f97b"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:50.174085 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-b25515df-33af-40e7-988d-fa0ba74cc9a1 req-74c82eeb-2b2d-4b1d-9ad8-c03d10f40de2 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.174528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-b25515df-33af-40e7-988d-fa0ba74cc9a1 req-74c82eeb-2b2d-4b1d-9ad8-c03d10f40de2 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.186760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-b25515df-33af-40e7-988d-fa0ba74cc9a1 req-74c82eeb-2b2d-4b1d-9ad8-c03d10f40de2 service nova] Creating event network-changed:5ece189e-0f97-4933-9eeb-db6e18b9f97b for instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 on hv-cinder-83588 May 12 15:41:50.192053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-b25515df-33af-40e7-988d-fa0ba74cc9a1 req-74c82eeb-2b2d-4b1d-9ad8-c03d10f40de2 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 May 12 15:41:50.192711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 316/603] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:50.271981 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:50.273006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:50.279127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.279996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.280355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.280813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.315477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-34c6ceb9-7ebe-4e8c-af06-fab9e9c7f49a tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047487 May 12 15:41:50.316378 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 288/604] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:41:50 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:41:50.375307 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:50.375852 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:50.382768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.383281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.384064 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.384529 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.411265 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:41:50.495254 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c3ae8936-9ff7-4666-a059-f3a5e80b3b2c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 204 len: 0 microversion: 2.1 time: 0.124022 May 12 15:41:50.495649 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 317/605] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:41:50 2022] DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:41:50.504774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:50.506149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:50.512791 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.513334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.514186 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:50.514800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:50.653869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:50.661413 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1f2875ad-2ca8-4dea-be95-7ed595656fd2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1675 microversion: 2.1 time: 0.161153 May 12 15:41:50.661978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 289/606] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:50 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:41:51.060094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:51.061472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:51.069686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:51.070394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:51.071171 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:51.071603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:51.103365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a7d5faf9-3fb0-44c3-bd9c-7e75e3c11ba5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047900 May 12 15:41:51.103951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 318/607] 10.222.0.89 () {60 vars in 1342 bytes} [Thu May 12 15:41:51 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:41:51.679711 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:51.680306 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:51.687383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:51.687872 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:51.688658 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:51.689096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:51.833851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:51.841701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c62b049d-abcc-4974-87cb-d2a1c2702fec tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1675 microversion: 2.1 time: 0.165939 May 12 15:41:51.842244 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 290/608] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:51 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:52.115494 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:52.116568 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:52.123484 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:52.123938 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:52.124739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:52.125175 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:52.155551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-31c062eb-a92b-443e-b33e-210c8549c88d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044204 May 12 15:41:52.156347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 319/609] 10.222.0.89 () {60 vars in 1342 bytes} [Thu May 12 15:41:52 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:41:52.207198 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-04084406-79e1-4399-a588-183a22cc3d3b req-5af7860b-953f-44ff-97bb-9541dddcfb8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa53a7ea-5acc-4021-ac22-69d92ef87b71", "tag": "5ece189e-0f97-4933-9eeb-db6e18b9f97b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:52.216456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-04084406-79e1-4399-a588-183a22cc3d3b req-5af7860b-953f-44ff-97bb-9541dddcfb8b service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:52.216935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-04084406-79e1-4399-a588-183a22cc3d3b req-5af7860b-953f-44ff-97bb-9541dddcfb8b service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:52.229397 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-04084406-79e1-4399-a588-183a22cc3d3b req-5af7860b-953f-44ff-97bb-9541dddcfb8b service nova] Creating event network-changed:5ece189e-0f97-4933-9eeb-db6e18b9f97b for instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 on hv-cinder-83588 May 12 15:41:52.234985 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-04084406-79e1-4399-a588-183a22cc3d3b req-5af7860b-953f-44ff-97bb-9541dddcfb8b service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031612 May 12 15:41:52.235616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 291/610] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:52.859241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:52.859836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:52.865947 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:52.866674 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:52.867441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:52.868022 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.051557 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:53.059360 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7d1489fd-8f59-4c7d-8e97-334fb2d1b5b6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1675 microversion: 2.1 time: 0.203910 May 12 15:41:53.060194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 320/611] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:52 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:53.169888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:53.171534 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:53.177855 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:53.178307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.179098 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:53.179529 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.209467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-393347db-a64c-41ff-a1ca-8083fd52d2d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045724 May 12 15:41:53.215324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 292/612] 10.222.0.89 () {60 vars in 1342 bytes} [Thu May 12 15:41:53 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:53.278321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:53.278902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:53.285204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:53.285987 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.286922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:53.287519 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.313317 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:41:53.407730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-53e86b39-bc02-46ac-a502-e125f4249c46 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 204 len: 0 microversion: 2.20 time: 0.132758 May 12 15:41:53.408334 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 321/613] 10.222.0.89 () {60 vars in 1279 bytes} [Thu May 12 15:41:53 2022] DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 12 15:41:53.417285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:53.418306 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:53.427037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:53.427773 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.428634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:53.429076 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:53.579831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:53.590191 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:53.591996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:53.593217 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a661c648-e6ed-41b7-8216-5dcb2b67ed63 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.180121 May 12 15:41:53.604760 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 293/614] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:41:53 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:41:54.077775 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:54.078588 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:54.085136 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:54.085596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:54.086392 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:54.087045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:54.155275 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:54.163357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1f9f875a-1643-4a24-8f79-29d60e0a7e5b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1607 microversion: 2.1 time: 0.089812 May 12 15:41:54.173547 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 322/615] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:54 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1607 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:54.250951 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-77f437c3-8148-4e5a-a85e-d96dc0a75619 req-e6697af3-eb0f-41cb-97d5-d78a7eba0517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be73f585-3978-4a35-b794-ccafc28dd120", "name": "network-vif-deleted", "tag": "b2e2caaf-0b7c-4bb6-abe2-83c670e57c31"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:54.259967 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-77f437c3-8148-4e5a-a85e-d96dc0a75619 req-e6697af3-eb0f-41cb-97d5-d78a7eba0517 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:54.260605 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-77f437c3-8148-4e5a-a85e-d96dc0a75619 req-e6697af3-eb0f-41cb-97d5-d78a7eba0517 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:54.272732 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-77f437c3-8148-4e5a-a85e-d96dc0a75619 req-e6697af3-eb0f-41cb-97d5-d78a7eba0517 service nova] Creating event network-vif-deleted:b2e2caaf-0b7c-4bb6-abe2-83c670e57c31 for instance be73f585-3978-4a35-b794-ccafc28dd120 on hv-cinder-83588 May 12 15:41:54.277836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-77f437c3-8148-4e5a-a85e-d96dc0a75619 req-e6697af3-eb0f-41cb-97d5-d78a7eba0517 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 May 12 15:41:54.278531 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 294/616] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:54.611466 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:54.612112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:54.619181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:54.619606 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:54.620631 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:54.621228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:55.181867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:55.182756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:55.189366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:55.189946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:55.190840 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:55.191388 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:55.224407 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:55.227471 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:55.228082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:55.228946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lazy-loading 'fault' on Instance uuid be73f585-3978-4a35-b794-ccafc28dd120 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:41:55.247133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:55.249179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:55.250516 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-625f55e4-e45e-4815-a928-0ea5e08d8107 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1720 microversion: 2.20 time: 0.643005 May 12 15:41:55.251930 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 323/617] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:41:54 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1720 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:41:55.347749 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:55.358038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c5b67f46-4f30-4de5-91a0-74209ccda0f4 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 200 len: 1328 microversion: 2.1 time: 0.180224 May 12 15:41:55.358664 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 295/618] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:55 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 1328 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:41:56.242215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-4b0e3e57-3218-4d95-8673-df31796320c5 req-9d959fe3-825f-430a-a9ee-d7ed9132b3bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a406a83-d33b-40db-adb0-9789902c45cb", "name": "network-vif-deleted", "tag": "18cd7191-e25f-4a20-a234-376a79b8ccdc"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:56.251468 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4b0e3e57-3218-4d95-8673-df31796320c5 req-9d959fe3-825f-430a-a9ee-d7ed9132b3bf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:56.252263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4b0e3e57-3218-4d95-8673-df31796320c5 req-9d959fe3-825f-430a-a9ee-d7ed9132b3bf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:56.265769 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-4b0e3e57-3218-4d95-8673-df31796320c5 req-9d959fe3-825f-430a-a9ee-d7ed9132b3bf service nova] Creating event network-vif-deleted:18cd7191-e25f-4a20-a234-376a79b8ccdc for instance 0a406a83-d33b-40db-adb0-9789902c45cb on hv-cinder-83588 May 12 15:41:56.272108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-4b0e3e57-3218-4d95-8673-df31796320c5 req-9d959fe3-825f-430a-a9ee-d7ed9132b3bf service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 May 12 15:41:56.272572 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:56.273182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 324/619] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:56.274486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:56.288867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:56.290023 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:56.293424 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:56.293424 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:56.368396 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:56.376793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:56.377485 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:56.384432 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:56.384976 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:56.385870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:56.386396 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:56.387993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:56.393058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:41:56.394311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e2a24f41-3cfc-4245-8d1d-2cf18b9c46af tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 200 len: 1366 microversion: 2.20 time: 0.128737 May 12 15:41:56.395507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 296/620] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:41:56 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] HTTP exception thrown: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Request method failure captured: May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 HTTP/1.1 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgGv2kq8w-fV7QqoD1hXhM8wu8rPG9lC6y3q5P-ChwwAYwuM6Ef743RKn4glbqTm_FOciQX_jtvzTbYjfi6ASqNb-RKnTshEeNNHzOUnrriREB-Yi03x9gBR9G0_6RPJnz0WFBFXkcsVxDqPpBN6RPpnA5zg2nH-jQvskJnLbOWM4 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:41:56.404602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8aba4b044dfa42cd8da55086ab774561", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeTestJSON-1015473642 May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 99d68f67eb8949e0b0878527f86ee683 May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:41:56.406234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'be73f585-3978-4a35-b794-ccafc28dd120'} May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:41:56.407160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:41:56.409246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:56.410546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Returning 404 to user: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:41:56.410546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a4fe9460-0a88-4b00-bf13-e31d1376ef81 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 404 len: 111 microversion: 2.1 time: 0.031629 May 12 15:41:56.410546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 325/621] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:56 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:41:56.412677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c829dd22-d954-40a5-8346-edf2d480e3a2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '.version_select at 0x7f60d0db21f0>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:56.435922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c829dd22-d954-40a5-8346-edf2d480e3a2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2147351746" status: 202 len: 0 microversion: 2.1 time: 0.026688 May 12 15:41:56.436401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 326/622] 10.222.0.89 () {58 vars in 1220 bytes} [Thu May 12 15:41:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2147351746 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 15:41:57.155867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4cbb134b-e607-44bf-85c4-451e0d6ff98c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: .version_select at 0x7f60d05a7c10>, body: {"keypair": {"name": "tempest-keypair-185708159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaefXmijCx6cb6cfgcFUKbT8ntIVrwm08zusZfGCI9V2wns762uFiu4+nU5oSlTOS1n4ebnoq4Y3B6CMgDUcy7bg/c9ltklCbqqs0yzPxaYrhvoy/ZeYgsvY5NoSkFGDg=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:57.171029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-4cbb134b-e607-44bf-85c4-451e0d6ff98c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for project 8aba4b044dfa42cd8da55086ab774561. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:41:57.175190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-4cbb134b-e607-44bf-85c4-451e0d6ff98c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for user 99d68f67eb8949e0b0878527f86ee683 and project 8aba4b044dfa42cd8da55086ab774561. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:41:57.197779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4cbb134b-e607-44bf-85c4-451e0d6ff98c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045745 May 12 15:41:57.204142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 297/623] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:41:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:41:57.415786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:57.417251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:41:57.423867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:57.424322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:57.425130 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:57.425574 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:57.439137 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] HTTP exception thrown: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Request method failure captured: May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb HTTP/1.1 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgxVuLB0b-yfEGINHfGJRbmuU6GfCy3L4PknuEXeyVETqyRo0wGFo7GstnccY02BYplHIE8dv5olN7iXqRnp4xKx-Z6vUHD_l-82PSwNtPzlpxLt4p_o1QK3gc5vfIfKOvlI1A-zAWQir2JR0R6h6TtRbLcwmidMfliMXOGdfb4xs May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Openstack-Nova-Api-Version: 2.20 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:41:57.440784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7d51f9d06bb148ecb297dcacdc8b0b32", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ee73f971f9844c85bd9b29749554dc37 May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:41:57.442527 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '0a406a83-d33b-40db-adb0-9789902c45cb'} May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:41:57.443544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:41:57.445094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:41:57.446817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Returning 404 to user: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:41:57.446817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9243e0c4-a34b-4aac-81be-22c10f2e20e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 404 len: 111 microversion: 2.20 time: 0.030874 May 12 15:41:57.446817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 327/624] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:41:57 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 15:41:57.451507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2c2df551-4b75-47a9-b942-4c6caa6f9dbd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '.version_select at 0x7f60d06438b0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:57.471836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2c2df551-4b75-47a9-b942-4c6caa6f9dbd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785619572" status: 204 len: 0 microversion: 2.20 time: 0.024301 May 12 15:41:57.472420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 298/625] 10.222.0.89 () {60 vars in 1258 bytes} [Thu May 12 15:41:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785619572 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 15:41:58.666503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9886abaa-db95-4966-bf93-1bdb6e0e1de9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'create', calling method: .version_select at 0x7f60d0fae430>, body: {"keypair": {"name": "tempest-keypair-1163988253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqII18rktJx6epVcSl7sLZOUXHfA+gUIpyb36Ho8HrTT27akevhO0uZRabUg/cw58csi5yBt7dYiCipuKfbENjkuSD5Qcmp79SNRjGjK9eLM9fGtZet74zyfu3qB0/aA=="}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:58.683322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-9886abaa-db95-4966-bf93-1bdb6e0e1de9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:41:58.687679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-9886abaa-db95-4966-bf93-1bdb6e0e1de9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for user ee73f971f9844c85bd9b29749554dc37 and project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:41:58.711990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9886abaa-db95-4966-bf93-1bdb6e0e1de9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049473 May 12 15:41:58.712806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 328/626] 10.222.0.89 () {62 vars in 1199 bytes} [Thu May 12 15:41:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 15:41:59.116626 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1012483685", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d950ca3-1243-4fb1-a3b9-399d6873531e"}], "security_groups": [{"name": "tempest-securitygroup--401679600"}], "key_name": "tempest-keypair-185708159", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:41:59.258779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] validate_networks() for [('6d950ca3-1243-4fb1-a3b9-399d6873531e', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:41:59.841948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:41:59.842404 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:41:59.842874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:41:59.843282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:41:59.843687 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:41:59.853177 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:59.853625 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:59.854464 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:41:59.854899 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:41:59.872117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for project 8aba4b044dfa42cd8da55086ab774561. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:41:59.876064 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Getting quotas for user 99d68f67eb8949e0b0878527f86ee683 and project 8aba4b044dfa42cd8da55086ab774561. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:41:59.887130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:41:59.889460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:41:59.936277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c4c9ce22-21ca-459d-b209-86be6c171fa2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.825205 May 12 15:41:59.942098 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 299/627] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:41:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:41:59.948063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ba332750-6465-49bc-8007-fb387aca3a83 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:41:59.948668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ba332750-6465-49bc-8007-fb387aca3a83 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:00.023345 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ba332750-6465-49bc-8007-fb387aca3a83 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:00.030182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ba332750-6465-49bc-8007-fb387aca3a83 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1237 microversion: 2.1 time: 0.086708 May 12 15:42:00.030974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 329/628] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:41:59 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:00.598554 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-889625709", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d0a8c52-c0ac-43a2-8769-296b117079bb"}], "security_groups": [{"name": "tempest-securitygroup--952166394"}], "key_name": "tempest-keypair-1163988253", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:00.700082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] validate_networks() for [('8d0a8c52-c0ac-43a2-8769-296b117079bb', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:42:01.047818 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:01.048398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:01.055277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:01.055734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:01.056512 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:01.056967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:01.088987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:42:01.089443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:42:01.090051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:42:01.090469 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:42:01.090880 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:42:01.100621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:01.101088 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:01.101897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:01.102330 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:01.120354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:42:01.122814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:01.125154 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Getting quotas for user ee73f971f9844c85bd9b29749554dc37 and project 7d51f9d06bb148ecb297dcacdc8b0b32. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:42:01.131606 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2d2b4140-f5fe-4f33-bab8-1d1df4a6c5e3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1297 microversion: 2.1 time: 0.087704 May 12 15:42:01.132956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 330/629] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:01 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:01.150451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:42:01.155676 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:42:01.222493 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a0a7aa3c-d6ca-4ec2-a3cd-3d98949f1f72 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.628672 May 12 15:42:01.225578 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 300/630] 10.222.0.89 () {62 vars in 1187 bytes} [Thu May 12 15:42:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 12 15:42:01.236256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-994fbbb5-ca04-4391-9ccd-0bc1ef6e09d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:01.237199 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-994fbbb5-ca04-4391-9ccd-0bc1ef6e09d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:01.305379 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-994fbbb5-ca04-4391-9ccd-0bc1ef6e09d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:01.314131 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-994fbbb5-ca04-4391-9ccd-0bc1ef6e09d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:01.315767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-994fbbb5-ca04-4391-9ccd-0bc1ef6e09d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:01.316971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-994fbbb5-ca04-4391-9ccd-0bc1ef6e09d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1281 microversion: 2.20 time: 0.085223 May 12 15:42:01.317704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 331/631] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:01 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:02.150983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:02.152525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:02.162313 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:02.163216 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:02.164085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:02.164775 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:02.334634 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:02.335879 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:02.348514 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:02.349283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:02.350283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:02.350939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:02.441413 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:02.447291 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:02.451993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-91d0631f-5537-4b72-8d7b-77424d721297 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1362 microversion: 2.1 time: 0.306722 May 12 15:42:02.455532 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 301/632] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:02 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:02.456339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:02.458308 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:02.459682 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9483f032-62cc-43d8-8d14-d83b550f21c6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1351 microversion: 2.20 time: 0.129008 May 12 15:42:02.470150 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 332/633] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:02 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:42:03.015656 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-240cc0f2-b94a-4c5e-9f71-b25f161d4218 req-67fc0dc7-7743-483e-8c33-a04f7182861a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9539d8d8-5b0b-44e3-a8a4-869350bf75da", "tag": "750fc7fd-59de-40ae-8a72-66a1e13bbe2a"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:03.033659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-240cc0f2-b94a-4c5e-9f71-b25f161d4218 req-67fc0dc7-7743-483e-8c33-a04f7182861a service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:03.036357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-240cc0f2-b94a-4c5e-9f71-b25f161d4218 req-67fc0dc7-7743-483e-8c33-a04f7182861a service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:03.063350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-240cc0f2-b94a-4c5e-9f71-b25f161d4218 req-67fc0dc7-7743-483e-8c33-a04f7182861a service nova] Creating event network-changed:750fc7fd-59de-40ae-8a72-66a1e13bbe2a for instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da on hv-cinder-83588 May 12 15:42:03.074246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-240cc0f2-b94a-4c5e-9f71-b25f161d4218 req-67fc0dc7-7743-483e-8c33-a04f7182861a service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065497 May 12 15:42:03.074867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 302/634] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:03.473420 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:03.473976 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:03.478926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:03.480694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:03.483824 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:03.484284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:03.485262 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:03.485921 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:03.489370 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:03.490045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:03.491080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:03.491727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:03.693563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:03.702049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f4d85dda-0bda-4b76-a463-bde06b24965d tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1362 microversion: 2.1 time: 0.234618 May 12 15:42:03.712532 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 333/635] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:03 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:03.713326 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:03.723992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-68352c53-faed-4d5e-b6fb-7d3042406f22 req-b09a3e57-abc6-4a55-88c6-fb5732c3ef3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:03.724192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:03.725450 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:03.726590 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-67c44888-9967-4753-a176-3411886e024c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.252482 May 12 15:42:03.727347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 303/636] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:03 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:03.749429 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-68352c53-faed-4d5e-b6fb-7d3042406f22 req-b09a3e57-abc6-4a55-88c6-fb5732c3ef3c service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:03.751596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-68352c53-faed-4d5e-b6fb-7d3042406f22 req-b09a3e57-abc6-4a55-88c6-fb5732c3ef3c service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:03.763948 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-68352c53-faed-4d5e-b6fb-7d3042406f22 req-b09a3e57-abc6-4a55-88c6-fb5732c3ef3c service nova] Creating event network-changed:6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f for instance 6089f367-763b-4daf-8849-37153b6e32f3 on hv-cinder-83588 May 12 15:42:03.769302 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-68352c53-faed-4d5e-b6fb-7d3042406f22 req-b09a3e57-abc6-4a55-88c6-fb5732c3ef3c service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049025 May 12 15:42:03.769937 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 334/637] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:42:04.745042 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:04.745724 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:04.757478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:04.758050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:04.758882 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:04.759326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:04.802125 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:04.803895 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:04.810110 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:04.811011 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:04.811970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:04.812635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:05.153793 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:05.159053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:05.161621 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ac6f3ffb-1235-4378-a841-2d0daa10ab12 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1362 microversion: 2.1 time: 0.440856 May 12 15:42:05.162209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 304/638] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:04 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:05.167586 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:05.169531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:05.170646 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-71252e8f-c096-4cf7-98eb-40c1af887542 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.430113 May 12 15:42:05.171222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 335/639] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:04 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:42:06.179104 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:06.179682 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:06.186883 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:06.187334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:06.188427 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:06.188571 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:06.250803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:06.251390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:06.257464 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:06.257915 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:06.258686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:06.259119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:06.355851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:06.364360 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a389377a-0a9a-4895-a313-9dd2c544d4c6 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1362 microversion: 2.1 time: 0.189227 May 12 15:42:06.373701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 305/640] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:06 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:06.399319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:06.407579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:06.409119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:06.410224 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-251c4a56-deee-4063-bd63-4ea88b49a7db tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.225499 May 12 15:42:06.410771 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 336/641] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:06 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:07.386079 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:07.387082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:07.398064 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:07.398818 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:07.400104 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:07.400888 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:07.427760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:07.428330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:07.435027 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:07.435476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:07.436244 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:07.436721 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:07.860705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:07.868129 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-71e61d62-752c-4ba5-a51a-00d6ec2ea28e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1362 microversion: 2.1 time: 0.489131 May 12 15:42:07.868261 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:07.868741 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 306/642] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:07 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:07.876732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:07.878471 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:07.879626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0a0b5467-99b4-45e7-b12d-f4c34c234a71 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.455964 May 12 15:42:07.880192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 337/643] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:07 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:07.968928 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-a339d219-34f8-4be4-964f-16cef36f0614 req-01e21ca4-95d1-47b5-8839-df6c5bec0ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9539d8d8-5b0b-44e3-a8a4-869350bf75da", "name": "network-vif-plugged", "status": "completed", "tag": "750fc7fd-59de-40ae-8a72-66a1e13bbe2a"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:07.978838 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-a339d219-34f8-4be4-964f-16cef36f0614 req-01e21ca4-95d1-47b5-8839-df6c5bec0ff0 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:07.979274 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-a339d219-34f8-4be4-964f-16cef36f0614 req-01e21ca4-95d1-47b5-8839-df6c5bec0ff0 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:07.993577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-a339d219-34f8-4be4-964f-16cef36f0614 req-01e21ca4-95d1-47b5-8839-df6c5bec0ff0 service nova] Creating event network-vif-plugged:750fc7fd-59de-40ae-8a72-66a1e13bbe2a for instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da on hv-cinder-83588 May 12 15:42:07.998644 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-a339d219-34f8-4be4-964f-16cef36f0614 req-01e21ca4-95d1-47b5-8839-df6c5bec0ff0 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034246 May 12 15:42:07.999423 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 307/644] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:08.889327 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:08.890319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:08.901590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:08.902328 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:08.902913 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:08.903633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:08.904061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:08.904319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:08.913185 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:08.913639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:08.914420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:08.914857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:09.093385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:09.097522 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:09.101062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cef44828-2a18-4479-aad3-294cdd794538 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1362 microversion: 2.1 time: 0.218075 May 12 15:42:09.101607 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 338/645] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:08 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:09.105798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:09.107278 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:09.108384 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d104f177-7a71-4281-9418-6b0a2b6b74e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.213308 May 12 15:42:09.108958 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 308/646] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:08 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:10.027020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-e037ae26-6378-43f7-9c55-8fef56c10529 req-1bf10667-a1cf-4851-9b77-0a50141c4179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "name": "network-vif-plugged", "status": "completed", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:10.036242 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-e037ae26-6378-43f7-9c55-8fef56c10529 req-1bf10667-a1cf-4851-9b77-0a50141c4179 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.036641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-e037ae26-6378-43f7-9c55-8fef56c10529 req-1bf10667-a1cf-4851-9b77-0a50141c4179 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.048124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-e037ae26-6378-43f7-9c55-8fef56c10529 req-1bf10667-a1cf-4851-9b77-0a50141c4179 service nova] Creating event network-vif-plugged:6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f for instance 6089f367-763b-4daf-8849-37153b6e32f3 on hv-cinder-83588 May 12 15:42:10.053336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-e037ae26-6378-43f7-9c55-8fef56c10529 req-1bf10667-a1cf-4851-9b77-0a50141c4179 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030069 May 12 15:42:10.053932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 339/647] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:10.118156 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:10.118733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:10.125249 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.125740 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.126519 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.126952 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.128327 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:10.129122 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:10.135884 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.136347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.137147 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.137582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.365561 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:10.373448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-50396325-9f2f-423f-bdc5-fd3afde2d8ba tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1548 microversion: 2.1 time: 0.259236 May 12 15:42:10.374019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 309/648] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:10 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:10.389706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:10.390167 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:10.393395 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:10.396015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.396490 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.397256 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:10.397681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:10.401857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:10.403423 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:10.404558 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0cf5762f-c9b5-40bb-891a-be24e280664d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.281825 May 12 15:42:10.405154 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 340/649] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:10 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:10.472316 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a52fb8c0-8756-4e13-9db9-ce75d4cb49b9 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086282 May 12 15:42:10.472963 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 310/650] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:42:10 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:11.422614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:11.423196 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:11.430183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:11.430717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:11.431498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:11.431932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:11.545786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-e2d8ed20-5297-494f-b67a-cd4fc276d5cc req-484f7d3c-bdde-4046-bd51-5c8fe761d453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9539d8d8-5b0b-44e3-a8a4-869350bf75da", "tag": "750fc7fd-59de-40ae-8a72-66a1e13bbe2a"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:11.554014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-e2d8ed20-5297-494f-b67a-cd4fc276d5cc req-484f7d3c-bdde-4046-bd51-5c8fe761d453 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:11.554448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-e2d8ed20-5297-494f-b67a-cd4fc276d5cc req-484f7d3c-bdde-4046-bd51-5c8fe761d453 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:11.565638 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-e2d8ed20-5297-494f-b67a-cd4fc276d5cc req-484f7d3c-bdde-4046-bd51-5c8fe761d453 service nova] Creating event network-changed:750fc7fd-59de-40ae-8a72-66a1e13bbe2a for instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da on hv-cinder-83588 May 12 15:42:11.570670 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-e2d8ed20-5297-494f-b67a-cd4fc276d5cc req-484f7d3c-bdde-4046-bd51-5c8fe761d453 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029301 May 12 15:42:11.571515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 311/651] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:42:11.596377 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:11.605198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:11.606615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:11.607720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5aa8afd8-e52e-48b5-b023-de484c885277 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1406 microversion: 2.20 time: 0.189150 May 12 15:42:11.608342 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 341/652] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:11 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:12.629379 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:12.630336 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:12.636758 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.637203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.637961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.638430 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.758677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:12.759275 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:12.765525 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.765971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.766714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.767127 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.774512 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:12.782642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:12.784105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:12.785275 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d86979ae-372a-4c46-943e-2ab1afe2460c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1597 microversion: 2.20 time: 0.162902 May 12 15:42:12.786329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 312/653] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:12 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1597 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:12.793010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:42:12.803100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:12.803633 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:12.809757 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.810208 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.810938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.811394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.870947 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e15199b3-be67-41a0-b061-55a39473085e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "DELETE /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 204 len: 0 microversion: 2.1 time: 0.115939 May 12 15:42:12.872074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 342/654] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:42:12 2022] DELETE /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 15:42:12.880983 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:12.882240 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:12.888077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.888565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.889431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:12.889766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:12.891477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7fae7c4c-7429-4e2c-a821-15a8897979ba tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092206 May 12 15:42:12.892155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 313/655] 10.222.0.89 () {60 vars in 1315 bytes} [Thu May 12 15:42:12 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 15:42:13.025670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:13.033529 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-088aff4c-8d22-46c8-b50c-730e711c001d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1579 microversion: 2.1 time: 0.156847 May 12 15:42:13.034138 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 343/656] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:12 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:42:14.052111 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:14.052776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:14.059285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:14.059736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:14.060527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:14.060962 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:14.114089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-27048659-136d-41c0-89ec-1d3fc4f35d9d req-d9a211d2-4fba-4bfd-9c21-74f03efefc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:14.122914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-27048659-136d-41c0-89ec-1d3fc4f35d9d req-d9a211d2-4fba-4bfd-9c21-74f03efefc50 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:14.123350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-27048659-136d-41c0-89ec-1d3fc4f35d9d req-d9a211d2-4fba-4bfd-9c21-74f03efefc50 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:14.134769 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-27048659-136d-41c0-89ec-1d3fc4f35d9d req-d9a211d2-4fba-4bfd-9c21-74f03efefc50 service nova] Creating event network-changed:6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f for instance 6089f367-763b-4daf-8849-37153b6e32f3 on hv-cinder-83588 May 12 15:42:14.140115 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-27048659-136d-41c0-89ec-1d3fc4f35d9d req-d9a211d2-4fba-4bfd-9c21-74f03efefc50 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029710 May 12 15:42:14.140749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 344/657] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:42:14.201272 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:14.209825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-286b8eec-b58f-453b-8552-fdc7b9551fc4 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1579 microversion: 2.1 time: 0.162159 May 12 15:42:14.210428 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 314/658] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:14 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:15.229480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:15.230207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:15.237051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:15.237510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:15.238478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:15.238918 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:15.484297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:15.492101 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2ec857e4-5df1-49a9-9594-c42a6e767f94 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 200 len: 1579 microversion: 2.1 time: 0.268190 May 12 15:42:15.492707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 345/659] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:15 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 1579 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:15.745709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-c99bd215-70ba-4c2a-a0fd-dfa0927e5825 req-fd9e2a20-7b2c-4ee4-8dfe-ee3dab53ec80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc5f8be-b344-46fd-bae9-266847ebfdc1", "name": "network-vif-deleted", "tag": "f92017be-34f1-4663-8133-b097ab792782"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:15.754741 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-c99bd215-70ba-4c2a-a0fd-dfa0927e5825 req-fd9e2a20-7b2c-4ee4-8dfe-ee3dab53ec80 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:15.755454 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-c99bd215-70ba-4c2a-a0fd-dfa0927e5825 req-fd9e2a20-7b2c-4ee4-8dfe-ee3dab53ec80 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:15.772349 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-c99bd215-70ba-4c2a-a0fd-dfa0927e5825 req-fd9e2a20-7b2c-4ee4-8dfe-ee3dab53ec80 service nova] Creating event network-vif-deleted:f92017be-34f1-4663-8133-b097ab792782 for instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 on hv-cinder-83588 May 12 15:42:15.781047 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-c99bd215-70ba-4c2a-a0fd-dfa0927e5825 req-fd9e2a20-7b2c-4ee4-8dfe-ee3dab53ec80 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105821 May 12 15:42:15.781673 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 315/660] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:16.509647 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:16.510243 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:16.517544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:16.517990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:16.518747 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:16.519165 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:16.534908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] HTTP exception thrown: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Request method failure captured: May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 HTTP/1.1 May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSoA1BMIUe1sKJzh0YAPq-L7dKCO8koWPT6H70HXJergK8Cj1bByKUJUe9P8Jzg57auB-HnJdtF9Efhq5d3Tu2eXR6AUGvMaISPeNjwNvZjpe9wQ94mAA5lRKW5xg-8IkMjyPY2LWRIMiYMws1RzTy1UP3Ob3wH2IBo0ycktzZl8N9Q May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:42:16.536735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_4b8824725a894bbcb17789008292c1e4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-TestVolumeBootPattern-972638363 May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-TestVolumeBootPattern-972638363-project May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 73bfb098d5f04da9adb7ae1d30fd30b1 May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-TestVolumeBootPattern-972638363-project May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:42:16.538220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '7dc5f8be-b344-46fd-bae9-266847ebfdc1'} May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:16.539900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:42:16.542362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:16.544094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Returning 404 to user: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:16.544094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-eaf2b19d-b83d-4462-8b72-332676bab73b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 404 len: 111 microversion: 2.1 time: 0.032687 May 12 15:42:16.544094 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 346/661] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:16 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:42:16.638829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-136789340", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546602223", "security_groups": [{"name": "tempest-secgroup-smoke-1255422790"}], "block_device_mapping_v2": [{"uuid": "5ce534b9-482e-427c-a2d3-4b69380a7a7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "869afb1f-8f08-43d2-8b78-38d5d6f40548"}]}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:16.760782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] validate_networks() for [('869afb1f-8f08-43d2-8b78-38d5d6f40548', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:42:17.200054 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:42:17.200518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:42:17.201008 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:42:17.201417 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:42:17.201833 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:42:17.211833 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:17.212293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:17.213127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:17.213557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:17.230180 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for project 4b8824725a894bbcb17789008292c1e4. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:42:17.234234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for user 73bfb098d5f04da9adb7ae1d30fd30b1 and project 4b8824725a894bbcb17789008292c1e4. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:42:17.293764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:42:17.295971 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ce534b9-482e-427c-a2d3-4b69380a7a7f',volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:42:17.447252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3e003e13-98b2-4e14-aa9c-416cfe19a4ec tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812602 May 12 15:42:17.447852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 316/662] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:42:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 15:42:17.458529 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-155c75bf-8d0c-400d-9f0d-76a0b4b5efbf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:17.459149 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-155c75bf-8d0c-400d-9f0d-76a0b4b5efbf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:17.511431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-155c75bf-8d0c-400d-9f0d-76a0b4b5efbf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:17.519457 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-155c75bf-8d0c-400d-9f0d-76a0b4b5efbf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1094 microversion: 2.1 time: 0.064891 May 12 15:42:17.520020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 347/663] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:17 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:18.537111 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:18.537727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:18.544840 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:18.545255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:18.546246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:18.546709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:18.805854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:18.813733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-da659aac-f188-4d16-9ccf-630c9810e1cb tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1210 microversion: 2.1 time: 0.281464 May 12 15:42:18.824582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 317/664] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:18 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1210 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:19.833558 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:19.834716 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:19.841983 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:19.842652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:19.843407 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:19.844072 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:20.033799 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:20.041792 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2877d647-999d-4f1b-abb5-c9c171ec698d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.214381 May 12 15:42:20.042422 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 348/665] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:19 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:20.120597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-eaff1ef4-fbac-486a-8f0a-c9c76bef571d req-9db24849-fd85-4684-9ad4-1c9cb75a1f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c50e59-f764-41d6-bd06-1a2ac7bc5d61", "tag": "ca51c60f-918e-4a96-8760-a4f1a7d0c522"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:20.130114 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-eaff1ef4-fbac-486a-8f0a-c9c76bef571d req-9db24849-fd85-4684-9ad4-1c9cb75a1f99 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:20.130823 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-eaff1ef4-fbac-486a-8f0a-c9c76bef571d req-9db24849-fd85-4684-9ad4-1c9cb75a1f99 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:20.144415 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-eaff1ef4-fbac-486a-8f0a-c9c76bef571d req-9db24849-fd85-4684-9ad4-1c9cb75a1f99 service nova] Creating event network-changed:ca51c60f-918e-4a96-8760-a4f1a7d0c522 for instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 on hv-cinder-83588 May 12 15:42:20.150766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-eaff1ef4-fbac-486a-8f0a-c9c76bef571d req-9db24849-fd85-4684-9ad4-1c9cb75a1f99 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034435 May 12 15:42:20.151709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 318/666] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:21.059436 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:21.060032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:21.066877 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:21.067437 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:21.068212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:21.068650 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:21.278669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:21.286939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c965aa02-1e99-4e4f-9857-14e89223286f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.231418 May 12 15:42:21.287513 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 349/667] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:21 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:22.311071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:22.312298 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:22.322623 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:22.323220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:22.324169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:22.324733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:22.460932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:22.468832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f3af2171-5624-4f31-b9ac-b775f13ba8d9 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.165498 May 12 15:42:22.469402 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 319/668] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:22 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:23.490129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:23.490872 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:23.499247 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:23.499816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:23.500823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:23.501372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:23.641624 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:23.651173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-21ecccdd-d251-4a11-a266-1d0927b1b6ba tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.167787 May 12 15:42:23.651740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 350/669] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:23 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:24.673257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:24.674298 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:24.685383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:24.686131 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:24.687442 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:24.688162 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:24.822426 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:24.835142 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4131436b-d9b8-4ce0-a4b7-70b3618e5e30 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.169795 May 12 15:42:24.836030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 320/670] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:24 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:25.861935 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:25.862800 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:25.870804 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:25.871301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:25.872163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:25.872662 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:26.007250 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:26.014737 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-14bd9fb5-246d-47fa-bbed-98812b8a82df tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.159668 May 12 15:42:26.015319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 351/671] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:25 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:27.040975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:27.042012 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:27.053428 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:27.054176 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:27.055497 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:27.056214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:27.192090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:27.203641 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ece8b214-ac81-417b-9b55-92d5feb75fc2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.169095 May 12 15:42:27.204365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 321/672] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:27 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:28.092251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:28.092842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:28.100902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:28.101390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:28.102192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:28.102630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:28.186782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lazy-loading 'services' on Instance uuid aa53a7ea-5acc-4021-ac22-69d92ef87b71 {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:42:28.222155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:28.222771 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:28.228920 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:28.229367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:28.230133 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:28.230564 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:28.264701 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-048e209f-d948-464c-ad39-f35d6e2e5aa9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments/91173c6d-fa3c-4d67-903e-df8f10c9acaf" status: 202 len: 0 microversion: 2.1 time: 0.178709 May 12 15:42:28.265277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 352/673] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:42:28 2022] DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments/91173c6d-fa3c-4d67-903e-df8f10c9acaf => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:42:28.273851 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:28.274932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:28.281370 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:28.281774 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:28.282559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:28.282993 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:28.314503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-96a7041a-cd03-426d-8b0b-84d717420831 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 May 12 15:42:28.315076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 353/674] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:42:28 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:42:28.387866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:28.395303 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-13da488e-cccd-4af1-be23-cdc087daadbe tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.176862 May 12 15:42:28.395851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 322/675] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:28 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:29.327202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:29.328148 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:29.334686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.335177 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.335951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.336390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.365838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7f4422b6-f66f-4452-b622-9fcb781bede8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042791 May 12 15:42:29.366426 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 354/676] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:42:29 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:42:29.411645 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:29.412257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:29.418973 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.419528 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.420278 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.420798 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.450426 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:29.450921 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:29.457233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.457690 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.458477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.459020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.486014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:42:29.554816 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:29.562659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5920f57f-c848-4a96-b7e4-360a484058e8 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.154971 May 12 15:42:29.563552 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 323/677] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:29 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:29.570949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4ef12083-1d21-40a9-85bc-28b9f997c251 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 204 len: 0 microversion: 2.1 time: 0.124175 May 12 15:42:29.571757 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 355/678] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:42:29 2022] DELETE /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 15:42:29.579326 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:29.579936 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:29.585947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.586394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.587160 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:29.587627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:29.727750 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:29.735286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6144f0e5-bfa9-428e-a499-00e4cfec8a3a tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1690 microversion: 2.1 time: 0.159720 May 12 15:42:29.735866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 324/679] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:29 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:42:30.584790 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:30.585925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:30.597097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:30.597846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:30.599213 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:30.599911 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:30.742568 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:30.751341 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a65c816f-12f4-45ce-950c-0ce91729d3b0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.173744 May 12 15:42:30.751976 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 356/680] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:30 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:30.752601 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:30.753214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:30.759939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:30.760433 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:30.761237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:30.761766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:30.908058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:30.916113 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5878f303-ff8d-43fb-94a6-0afbd838a0f8 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1690 microversion: 2.1 time: 0.167487 May 12 15:42:30.916727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 325/681] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:30 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:31.768232 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:31.768903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:31.775522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:31.775958 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:31.776794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:31.777239 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:31.912459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:31.915070 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-ccf12ee5-caf1-45ca-bafc-4f9b29d72b9a req-6d47229a-ba1c-4923-bb28-da08ce490a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c50e59-f764-41d6-bd06-1a2ac7bc5d61", "name": "network-vif-plugged", "status": "completed", "tag": "ca51c60f-918e-4a96-8760-a4f1a7d0c522"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:31.921103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1bf07e3a-3f5c-4a6b-a422-9d2ea1dbb811 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.156797 May 12 15:42:31.921770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 357/682] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:31 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:31.924448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-ccf12ee5-caf1-45ca-bafc-4f9b29d72b9a req-6d47229a-ba1c-4923-bb28-da08ce490a42 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:31.924928 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-ccf12ee5-caf1-45ca-bafc-4f9b29d72b9a req-6d47229a-ba1c-4923-bb28-da08ce490a42 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:31.932409 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:31.933314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:31.936367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-ccf12ee5-caf1-45ca-bafc-4f9b29d72b9a req-6d47229a-ba1c-4923-bb28-da08ce490a42 service nova] Creating event network-vif-plugged:ca51c60f-918e-4a96-8760-a4f1a7d0c522 for instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 on hv-cinder-83588 May 12 15:42:31.941661 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-ccf12ee5-caf1-45ca-bafc-4f9b29d72b9a req-6d47229a-ba1c-4923-bb28-da08ce490a42 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090116 May 12 15:42:31.942271 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 326/683] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:31.946624 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:31.947114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:31.947902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:31.948336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:32.077357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:32.088722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-25ab844c-54a4-4ae2-b041-d90c77dc782e tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1690 microversion: 2.1 time: 0.159921 May 12 15:42:32.089295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 358/684] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:31 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:42:32.938987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:32.940071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:32.946660 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:32.947115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:32.947911 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:32.948333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:33.106318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:33.107128 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:33.133759 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:33.134249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:33.135044 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:33.135480 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:33.213182 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:33.221350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c0c13524-dbb9-4a6b-a5c1-dff0d00e8d3c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.287122 May 12 15:42:33.221953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 327/685] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:32 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:33.393572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:33.401821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-07fe0ff8-c6c6-4c1a-9823-b61060296fec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1690 microversion: 2.1 time: 0.299464 May 12 15:42:33.402383 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 359/686] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:33 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1690 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:34.058837 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-d1c52133-0128-4b54-ab5f-434122e700d7 req-6eb88d43-551f-4c57-8a9b-70507d60e898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa53a7ea-5acc-4021-ac22-69d92ef87b71", "name": "network-vif-deleted", "tag": "5ece189e-0f97-4933-9eeb-db6e18b9f97b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:34.070010 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-d1c52133-0128-4b54-ab5f-434122e700d7 req-6eb88d43-551f-4c57-8a9b-70507d60e898 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:34.070731 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-d1c52133-0128-4b54-ab5f-434122e700d7 req-6eb88d43-551f-4c57-8a9b-70507d60e898 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:34.082369 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-d1c52133-0128-4b54-ab5f-434122e700d7 req-6eb88d43-551f-4c57-8a9b-70507d60e898 service nova] Creating event network-vif-deleted:5ece189e-0f97-4933-9eeb-db6e18b9f97b for instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 on hv-cinder-83588 May 12 15:42:34.087834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-d1c52133-0128-4b54-ab5f-434122e700d7 req-6eb88d43-551f-4c57-8a9b-70507d60e898 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 May 12 15:42:34.088590 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 328/687] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:34.240283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:34.241714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:34.248260 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:34.249525 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:34.250334 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:34.250953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:34.385334 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:34.393102 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2d6aa463-26b3-4af4-9eb3-67eb90c5c92a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1266 microversion: 2.1 time: 0.157866 May 12 15:42:34.393678 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 360/688] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:34 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:34.419843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:34.420532 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:34.427250 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:34.427692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:34.428456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:34.428922 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:34.460515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:34.460987 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:34.461436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lazy-loading 'fault' on Instance uuid aa53a7ea-5acc-4021-ac22-69d92ef87b71 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:42:34.503332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:34.511884 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5e751f78-ced5-4fe2-b939-2d0196880a67 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 200 len: 1334 microversion: 2.1 time: 0.096598 May 12 15:42:34.512504 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 329/689] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:34 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:35.410213 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:35.410814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:35.418198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:35.418639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:35.419405 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:35.419836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:35.529140 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:35.529804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: aa53a7ea-5acc-4021-ac22-69d92ef87b71] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:35.536743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:35.537188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:35.537937 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:35.538372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:35.552576 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] HTTP exception thrown: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 could not be found. May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Request method failure captured: May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 HTTP/1.1 May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSnmslxjOw92y13wHry1lWnGADOsl6791JPT6gMnRLwjaADu5UkamgnmBKpOKr6X6iJ1JkGQAbaWm0pk7DkVPavaMt8-cwkw-sMdtcwmgS9L6qzNQyYFnh5Si8OR-0EOLjbRfOvjANcMd5yAPEZm9tunNuyIuvYgKqyAG8Xracq1I8A May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:42:35.554518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72d34bbf298a42fc943c77b2d90747e6", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: eaf5525a857c46ca9000626e60136eb9 May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 could not be found. May 12 15:42:35.556192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'aa53a7ea-5acc-4021-ac22-69d92ef87b71'} May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 could not be found. May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:35.557119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 could not be found. May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 could not be found. May 12 15:42:35.558570 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:35.559832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Returning 404 to user: Instance aa53a7ea-5acc-4021-ac22-69d92ef87b71 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:35.559832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c1e72949-f292-4e16-8873-3bf7c1a188ec tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71" status: 404 len: 111 microversion: 2.1 time: 0.030888 May 12 15:42:35.559832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 330/690] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:35 2022] GET /compute/v2.1/servers/aa53a7ea-5acc-4021-ac22-69d92ef87b71 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:35.560859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:35.564351 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4cade43c-0739-4043-820d-16f183e57748 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '.version_select at 0x7f60d0574d30>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:35.568865 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5bbc2812-3cce-441f-93fb-28a02a44ba4a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1453 microversion: 2.1 time: 0.162555 May 12 15:42:35.569442 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 361/691] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:35 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:35.583071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4cade43c-0739-4043-820d-16f183e57748 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872514868" status: 202 len: 0 microversion: 2.1 time: 0.022303 May 12 15:42:35.583674 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 331/692] 10.222.0.89 () {58 vars in 1217 bytes} [Thu May 12 15:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872514868 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:42:35.585256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:35.585854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:35.592074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:35.592561 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:35.593384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:35.593852 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:35.724187 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:35.738224 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7bde03d3-2a68-4935-948b-5c4cf80c8ccf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1453 microversion: 2.1 time: 0.157140 May 12 15:42:35.749757 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 362/693] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:35 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:42:37.650684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-1fe0a787-4f43-42b7-b2f8-cbf8564e0414 req-4c744db3-0326-44de-8c87-c9dcf06edada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c50e59-f764-41d6-bd06-1a2ac7bc5d61", "tag": "ca51c60f-918e-4a96-8760-a4f1a7d0c522"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:37.659452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-1fe0a787-4f43-42b7-b2f8-cbf8564e0414 req-4c744db3-0326-44de-8c87-c9dcf06edada service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:37.659893 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-1fe0a787-4f43-42b7-b2f8-cbf8564e0414 req-4c744db3-0326-44de-8c87-c9dcf06edada service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:37.671039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-1fe0a787-4f43-42b7-b2f8-cbf8564e0414 req-4c744db3-0326-44de-8c87-c9dcf06edada service nova] Creating event network-changed:ca51c60f-918e-4a96-8760-a4f1a7d0c522 for instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 on hv-cinder-83588 May 12 15:42:37.675978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-1fe0a787-4f43-42b7-b2f8-cbf8564e0414 req-4c744db3-0326-44de-8c87-c9dcf06edada service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029679 May 12 15:42:37.676602 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 332/694] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:38.464919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:38.465481 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:38.471900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:38.472357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:38.473154 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:38.473594 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:38.499424 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:42:38.584006 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1790f928-2b4f-4618-b24e-4c607c0b54cc tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "DELETE /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 204 len: 0 microversion: 2.1 time: 0.122530 May 12 15:42:38.585039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 363/695] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:42:38 2022] DELETE /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:42:38.594166 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:38.594852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:38.601238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:38.601686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:38.602455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:38.602925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:38.737515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:38.745919 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-44974c05-9230-4309-b78a-34e9bcef1648 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1509 microversion: 2.1 time: 0.156285 May 12 15:42:38.746496 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 333/696] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:38 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:42:39.768540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:39.769721 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:39.780519 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:39.781222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:39.782559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:39.783286 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:39.916423 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:39.924819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0dfac8b0-d450-413a-aa0a-632360e97285 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1509 microversion: 2.1 time: 0.163480 May 12 15:42:39.925397 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 364/697] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:39 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:40.944866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:40.945736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:40.954460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:40.955088 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:40.956263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:40.956985 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:41.147532 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:41.155348 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-230f3df3-7522-4bc4-85f5-e03a02cf0e37 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 200 len: 1509 microversion: 2.1 time: 0.216123 May 12 15:42:41.155931 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 334/698] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:40 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:41.544703 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-3430e73c-f0a8-495c-af63-0d1e73b24df2 req-3426ad18-42e6-43fd-8242-284fdbcc13e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08d195c-139d-4504-9584-6d6cdda60bc2", "name": "network-vif-deleted", "tag": "5c5b0249-be7e-446e-bb63-8151deda53b2"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:41.553766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-3430e73c-f0a8-495c-af63-0d1e73b24df2 req-3426ad18-42e6-43fd-8242-284fdbcc13e9 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:41.554203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-3430e73c-f0a8-495c-af63-0d1e73b24df2 req-3426ad18-42e6-43fd-8242-284fdbcc13e9 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:41.565824 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-3430e73c-f0a8-495c-af63-0d1e73b24df2 req-3426ad18-42e6-43fd-8242-284fdbcc13e9 service nova] Creating event network-vif-deleted:5c5b0249-be7e-446e-bb63-8151deda53b2 for instance a08d195c-139d-4504-9584-6d6cdda60bc2 on hv-cinder-83588 May 12 15:42:41.571249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-3430e73c-f0a8-495c-af63-0d1e73b24df2 req-3426ad18-42e6-43fd-8242-284fdbcc13e9 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030837 May 12 15:42:41.572665 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 365/699] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:42.177155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:42.177913 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: a08d195c-139d-4504-9584-6d6cdda60bc2] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:42.185399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:42.185896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:42.186761 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:42.187230 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:42.202080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] HTTP exception thrown: Instance a08d195c-139d-4504-9584-6d6cdda60bc2 could not be found. May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Request method failure captured: May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 HTTP/1.1 May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSnmslxjOw92y13wHry1lWnGADOsl6791JPT6gMnRLwjaADu5UkamgnmBKpOKr6X6iJ1JkGQAbaWm0pk7DkVPavaMt8-cwkw-sMdtcwmgS9L6qzNQyYFnh5Si8OR-0EOLjbRfOvjANcMd5yAPEZm9tunNuyIuvYgKqyAG8Xracq1I8A May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:42:42.203898 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72d34bbf298a42fc943c77b2d90747e6", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: eaf5525a857c46ca9000626e60136eb9 May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance a08d195c-139d-4504-9584-6d6cdda60bc2 could not be found. May 12 15:42:42.205694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'a08d195c-139d-4504-9584-6d6cdda60bc2'} May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08d195c-139d-4504-9584-6d6cdda60bc2 could not be found. May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:42.206607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08d195c-139d-4504-9584-6d6cdda60bc2 could not be found. May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08d195c-139d-4504-9584-6d6cdda60bc2 could not be found. May 12 15:42:42.207953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:42.209431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Returning 404 to user: Instance a08d195c-139d-4504-9584-6d6cdda60bc2 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:42.209431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a5bcd0ef-d593-49f4-8f81-578086cac970 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2" status: 404 len: 111 microversion: 2.1 time: 0.035054 May 12 15:42:42.209431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 335/700] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:42 2022] GET /compute/v2.1/servers/a08d195c-139d-4504-9584-6d6cdda60bc2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:42.215427 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:42.215999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:42.222619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:42.223063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:42.223823 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:42.224256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:42.249636 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:42:42.328460 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3456e0b2-dcf5-4bd3-8dba-27de94ead498 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "DELETE /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 204 len: 0 microversion: 2.1 time: 0.116918 May 12 15:42:42.329251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 366/701] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:42:42 2022] DELETE /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:42:42.338655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:42.339783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:42.347065 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:42.347786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:42.349266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:42.350000 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:42.486511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:42.494366 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b016b186-c8a0-4583-a10a-79f717500364 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.160276 May 12 15:42:42.494924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 336/702] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:42 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:43.513625 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:43.514877 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:43.523896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:43.524416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:43.525495 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:43.526082 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:43.668447 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:43.679737 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-174206ea-1fd9-4304-b367-912950594078 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.171703 May 12 15:42:43.680304 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 367/703] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:43 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:44.700215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:44.701225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:44.712028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:44.712854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:44.714138 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:44.714865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:44.848057 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:44.856262 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-dcce01d0-a2ab-4370-b40f-95eee8f2c4a9 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.162558 May 12 15:42:44.856877 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 337/704] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:44 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:45.874216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:45.874843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:45.881269 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:45.881717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:45.882476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:45.882903 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:46.069525 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaf5525a857c46ca9000626e60136eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d34bbf298a42fc943c77b2d90747e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:46.079145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4211d6a9-9ce7-4e7b-a091-5386c5b3e236 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 200 len: 1521 microversion: 2.1 time: 0.208737 May 12 15:42:46.080357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 368/705] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:45 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:42:46.226924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-04faf2f5-29ee-40ac-bcd4-6363f8da1c03 req-2651c83d-df4d-4c86-866b-9f81415d6602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f2fa5c-7d16-4c2e-978e-c63f357f460f", "name": "network-vif-deleted", "tag": "bb4489c9-042d-4dc5-8442-2157497a78a3"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:46.236786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-04faf2f5-29ee-40ac-bcd4-6363f8da1c03 req-2651c83d-df4d-4c86-866b-9f81415d6602 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:46.237770 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-04faf2f5-29ee-40ac-bcd4-6363f8da1c03 req-2651c83d-df4d-4c86-866b-9f81415d6602 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:46.254046 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-04faf2f5-29ee-40ac-bcd4-6363f8da1c03 req-2651c83d-df4d-4c86-866b-9f81415d6602 service nova] Creating event network-vif-deleted:bb4489c9-042d-4dc5-8442-2157497a78a3 for instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f on hv-cinder-83588 May 12 15:42:46.260391 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-04faf2f5-29ee-40ac-bcd4-6363f8da1c03 req-2651c83d-df4d-4c86-866b-9f81415d6602 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037394 May 12 15:42:46.261014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 338/706] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:47.101701 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:47.102674 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] [instance: f2f2fa5c-7d16-4c2e-978e-c63f357f460f] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:47.113622 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:47.114616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:47.115905 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:47.116818 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:47.134469 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] HTTP exception thrown: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f could not be found. May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Request method failure captured: May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f HTTP/1.1 May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSnmslxjOw92y13wHry1lWnGADOsl6791JPT6gMnRLwjaADu5UkamgnmBKpOKr6X6iJ1JkGQAbaWm0pk7DkVPavaMt8-cwkw-sMdtcwmgS9L6qzNQyYFnh5Si8OR-0EOLjbRfOvjANcMd5yAPEZm9tunNuyIuvYgKqyAG8Xracq1I8A May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:42:47.136194 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_72d34bbf298a42fc943c77b2d90747e6", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/72d34bbf298a42fc943c77b2d90747e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 72d34bbf298a42fc943c77b2d90747e6 May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420370949 May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: eaf5525a857c46ca9000626e60136eb9 May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420370949-project May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f could not be found. May 12 15:42:47.137909 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'f2f2fa5c-7d16-4c2e-978e-c63f357f460f'} May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f could not be found. May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:47.138986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f could not be found. May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f could not be found. May 12 15:42:47.140598 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:47.141966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] Returning 404 to user: Instance f2f2fa5c-7d16-4c2e-978e-c63f357f460f could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:47.141966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-589fb3c3-11ba-477e-aca0-5463893bb030 tempest-ServerRescueNegativeTestJSON-420370949 tempest-ServerRescueNegativeTestJSON-420370949-project] 10.222.0.89 "GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f" status: 404 len: 111 microversion: 2.1 time: 0.042997 May 12 15:42:47.141966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 369/707] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:42:47 2022] GET /compute/v2.1/servers/f2f2fa5c-7d16-4c2e-978e-c63f357f460f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:47.747882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:47.748546 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:47.755072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:47.755528 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:47.756311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:47.756791 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:47.780304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ba593b15-05ae-48fe-b29d-2564466d27c2 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/ips" status: 200 len: 146 microversion: 2.1 time: 0.036802 May 12 15:42:47.781185 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 339/708] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:42:47 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:49.121223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d599ce51-a9c5-4a37-81a7-d862f070f5c2"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:49.122517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:49.129306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:49.129990 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:49.131003 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:49.131475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:49.402459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-57c636c9-ef70-4c5d-b4a8-25b1117e9382 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285380 May 12 15:42:49.403278 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 370/709] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:42:49 2022] POST /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:50.340511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:50.341652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:50.348783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:50.349494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:50.350314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:50.350762 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:50.381672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-940b33b2-df9e-40eb-9cb3-6c93d940951f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/ips" status: 200 len: 150 microversion: 2.20 time: 0.045302 May 12 15:42:50.382573 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 340/710] 10.222.0.89 () {60 vars in 1288 bytes} [Thu May 12 15:42:50 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:42:52.123838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0664f684-40c2-4c75-a4dc-b8d9e3b48fc9 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Action: 'create', calling method: .version_select at 0x7f60d0ca7430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-948331206"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:52.427417 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0664f684-40c2-4c75-a4dc-b8d9e3b48fc9 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.427125 May 12 15:42:52.428089 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 371/711] 10.222.0.89 () {60 vars in 1154 bytes} [Thu May 12 15:42:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 429 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 15:42:52.439514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-857bdb08-810a-4378-8b1b-41cd8e1a2268 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0676d30>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:52.487656 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-857bdb08-810a-4378-8b1b-41cd8e1a2268 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 200 len: 344 microversion: 2.1 time: 0.052049 May 12 15:42:52.488286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 341/712] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:42:52 2022] GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:53.033556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:53.034524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:53.048036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:53.048904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:53.050444 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:53.051619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:53.075682 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lazy-loading 'flavor' on Instance uuid 6089f367-763b-4daf-8849-37153b6e32f3 {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:42:53.333531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fecfe8ea-0735-4a38-a82e-f57805f354e7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/action" status: 202 len: 0 microversion: 2.20 time: 0.306876 May 12 15:42:53.334207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 372/713] 10.222.0.89 () {62 vars in 1318 bytes} [Thu May 12 15:42:53 2022] POST /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 15:42:53.342589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:53.343255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:53.349376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:53.349895 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:53.350837 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:53.351296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:53.486513 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:53.494869 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:53.496404 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:53.497604 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9afa4cfc-d96e-417e-9b41-38424f6ecd1b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.159025 May 12 15:42:53.498169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 342/714] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:53 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:42:53.500744 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f79b5c1e-2c6d-404a-94ac-21895230b319 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0ce9820>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:53.550037 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f79b5c1e-2c6d-404a-94ac-21895230b319 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 200 len: 345 microversion: 2.1 time: 0.053416 May 12 15:42:53.550579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 373/715] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:42:53 2022] GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:53.561784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1fad9f30-957b-4d5a-a062-66c8d30b3aa0 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Action: 'create', calling method: .version_select at 0x7f60d05635e0>, body: {"snapshot": {"volume_id": "a28cf4ef-bc29-4267-886a-a260b890add1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-210248308"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:53.717459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1fad9f30-957b-4d5a-a062-66c8d30b3aa0 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.159407 May 12 15:42:53.718273 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 343/716] 10.222.0.89 () {60 vars in 1161 bytes} [Thu May 12 15:42:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:53.729068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-703476e1-5370-4d75-b22d-e38f09bb4164 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0ed7e50>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:53.761545 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-703476e1-5370-4d75-b22d-e38f09bb4164 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 200 len: 286 microversion: 2.1 time: 0.037213 May 12 15:42:53.762166 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 374/717] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:53 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:53.771974 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-fe9c169c-5bdf-493f-af27-5048fb1fcf5a tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0562f70>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:53.800036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-fe9c169c-5bdf-493f-af27-5048fb1fcf5a tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031830 May 12 15:42:53.800622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 344/718] 10.222.0.89 () {58 vars in 1139 bytes} [Thu May 12 15:42:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:53.813283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6c3fe4cd-d26f-4604-b898-6cb30454f954 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0c8c310>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:53.845712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6c3fe4cd-d26f-4604-b898-6cb30454f954 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 200 len: 286 microversion: 2.1 time: 0.038566 May 12 15:42:53.846306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 375/719] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:53 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:54.516096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:54.516704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:54.526480 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:54.526944 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:54.527740 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:54.528187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:54.669928 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:54.677961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:54.679469 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:54.680663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e9df9a7a-e8ef-4a70-bf04-147d256a330e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.168939 May 12 15:42:54.681205 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 345/720] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:54 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:54.862342 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-96331572-0e02-45c3-a983-1c17d482fdc5 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0ce9f70>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:54.893114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-96331572-0e02-45c3-a983-1c17d482fdc5 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 200 len: 286 microversion: 2.1 time: 0.038043 May 12 15:42:54.893688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 376/721] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:54 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:55.703311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:55.704261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:55.714149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:55.714600 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:55.715363 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:55.715793 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:55.852514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:55.861113 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:55.862633 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:55.863827 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f5c2299e-3099-49a1-be8b-5f541452420f tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.167096 May 12 15:42:55.864365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 346/722] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:55 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:55.908620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-24a899f1-5e32-4608-bd30-cffddc7fda80 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0cccd30>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:55.940506 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-24a899f1-5e32-4608-bd30-cffddc7fda80 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 200 len: 286 microversion: 2.1 time: 0.037104 May 12 15:42:55.941075 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 377/723] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:55 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:56.882943 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:56.883609 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:56.890290 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:56.890825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:56.891783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:56.892191 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:56.953138 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a7458cb7-2840-41c0-8589-ac5f430791ce tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0cb25e0>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:56.984590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a7458cb7-2840-41c0-8589-ac5f430791ce tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 200 len: 287 microversion: 2.1 time: 0.035676 May 12 15:42:56.985162 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 378/724] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:56 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:56.996682 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-27588d62-5053-4282-96af-bf30760cb537 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0ccc1f0>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:57.028538 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:57.037942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:57.039989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:57.041553 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-21200212-0594-4e08-9820-25fff15ad978 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.162919 May 12 15:42:57.042321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 347/725] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:56 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:57.061610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-27588d62-5053-4282-96af-bf30760cb537 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "DELETE /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 202 len: 0 microversion: 2.1 time: 0.068511 May 12 15:42:57.062224 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 379/726] 10.222.0.89 () {58 vars in 1253 bytes} [Thu May 12 15:42:56 2022] DELETE /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:42:57.071355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9ac6806f-a5d7-4a34-b435-c0d5118ccaeb tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0574b80>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:57.102359 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9ac6806f-a5d7-4a34-b435-c0d5118ccaeb tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 200 len: 286 microversion: 2.1 time: 0.035342 May 12 15:42:57.102927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 348/727] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:57 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:58.043694 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:58.045241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:58.055283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:58.055932 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:58.056923 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:58.057363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:58.063806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:58.064339 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:58.070502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:58.070957 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:58.071707 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:58.072132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:58.089373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-75063a94-9244-4015-8f14-229dda489067 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053243 May 12 15:42:58.090286 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 380/728] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:42:58 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:58.099752 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:58.100231 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:58.106302 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:58.106734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:58.107490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:58.107940 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:58.136632 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0ebd816d-afb5-4123-b2d7-9a2ea49a052e tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/d599ce51-a9c5-4a37-81a7-d862f070f5c2" status: 200 len: 194 microversion: 2.1 time: 0.040490 May 12 15:42:58.137234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 381/729] 10.222.0.89 () {58 vars in 1412 bytes} [Thu May 12 15:42:58 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/d599ce51-a9c5-4a37-81a7-d862f070f5c2 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:42:58.141828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3751e96-03b4-4302-84f8-dafb77d25d35 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0d31160>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:58.166405 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-c3751e96-03b4-4302-84f8-dafb77d25d35 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] HTTP exception thrown: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3751e96-03b4-4302-84f8-dafb77d25d35 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Request method failure captured: May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 HTTP/1.1 May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSr7AW4pQz-nnQoD724IlYGjLIzu6f4HRkBtt6zFq0DrSV6feli2rrZxbpC1OslH3iCZQvLArQGKyITu6R1ISfOXuDMJCXlcCtaBsfCM553ppjekN7znmkih5OxlzJBzpNDJBUUQvBiee2bcIZW-qexLabNboNX1miGqHy7wt_nc00Q May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:42:58.169215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1481509f8db146b3a536cd54c966b113", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1481509f8db146b3a536cd54c966b113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: a64b3606c510413c92abc2593d3f3615 May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'c628da2f-190d-40da-b6d6-450da69e2a16'} May 12 15:42:58.170550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. (HTTP 404) (Request-ID: req-3308ba22-70c3-4049-939f-a17339c08536) May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.171354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:42:58.172523 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 15:42:58.173725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c3751e96-03b4-4302-84f8-dafb77d25d35 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Returning 404 to user: Snapshot c628da2f-190d-40da-b6d6-450da69e2a16 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:58.176998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c3751e96-03b4-4302-84f8-dafb77d25d35 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16" status: 404 len: 111 microversion: 2.1 time: 0.032472 May 12 15:42:58.179085 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 382/730] 10.222.0.89 () {58 vars in 1250 bytes} [Thu May 12 15:42:58 2022] GET /compute/v2.1/os-snapshots/c628da2f-190d-40da-b6d6-450da69e2a16 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:58.179665 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9707c100-0e5b-4b17-8bbd-05949b924cf9 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0ce9700>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:58.206781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:58.214696 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:58.216181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:58.217375 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-42432355-4086-46b9-ab53-730d93c07589 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.158049 May 12 15:42:58.217937 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 349/731] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:58 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:42:58.243726 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9707c100-0e5b-4b17-8bbd-05949b924cf9 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 202 len: 0 microversion: 2.1 time: 0.067697 May 12 15:42:58.244299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 383/732] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:42:58 2022] DELETE /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:42:58.252937 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-086d8b04-dcf8-4781-9143-818a7927382f tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0626dc0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:58.302177 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-086d8b04-dcf8-4781-9143-818a7927382f tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 200 len: 344 microversion: 2.1 time: 0.053396 May 12 15:42:58.302763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 350/733] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:42:58 2022] GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:42:59.240047 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:59.241068 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:59.251368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:59.252139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:59.253475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:59.254204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:59.314897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0de9f476-8460-4ffc-adfc-208a7752699c tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d05634c0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:59.344438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-0de9f476-8460-4ffc-adfc-208a7752699c tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] HTTP exception thrown: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0de9f476-8460-4ffc-adfc-208a7752699c tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Request method failure captured: May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 HTTP/1.1 May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSr7AW4pQz-nnQoD724IlYGjLIzu6f4HRkBtt6zFq0DrSV6feli2rrZxbpC1OslH3iCZQvLArQGKyITu6R1ISfOXuDMJCXlcCtaBsfCM553ppjekN7znmkih5OxlzJBzpNDJBUUQvBiee2bcIZW-qexLabNboNX1miGqHy7wt_nc00Q May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:42:59.346784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1481509f8db146b3a536cd54c966b113", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1481509f8db146b3a536cd54c966b113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: a64b3606c510413c92abc2593d3f3615 May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'a28cf4ef-bc29-4267-886a-a260b890add1'} May 12 15:42:59.348238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. (HTTP 404) (Request-ID: req-03001721-86cf-48ea-9a53-4d920d310034) May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.349165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:42:59.357090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 15:42:59.358305 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0de9f476-8460-4ffc-adfc-208a7752699c tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Returning 404 to user: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0de9f476-8460-4ffc-adfc-208a7752699c tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 404 len: 109 microversion: 2.1 time: 0.038388 May 12 15:42:59.360897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 351/734] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:42:59 2022] GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:59.368531 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4f68295c-0898-4b56-88df-06d88f1c5881 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d05633a0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:59.396927 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:59.398466 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-4f68295c-0898-4b56-88df-06d88f1c5881 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] HTTP exception thrown: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4f68295c-0898-4b56-88df-06d88f1c5881 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Request method failure captured: May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 HTTP/1.1 May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSr7AW4pQz-nnQoD724IlYGjLIzu6f4HRkBtt6zFq0DrSV6feli2rrZxbpC1OslH3iCZQvLArQGKyITu6R1ISfOXuDMJCXlcCtaBsfCM553ppjekN7znmkih5OxlzJBzpNDJBUUQvBiee2bcIZW-qexLabNboNX1miGqHy7wt_nc00Q May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:42:59.400406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1481509f8db146b3a536cd54c966b113", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1481509f8db146b3a536cd54c966b113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: a64b3606c510413c92abc2593d3f3615 May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'a28cf4ef-bc29-4267-886a-a260b890add1'} May 12 15:42:59.402059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. (HTTP 404) (Request-ID: req-0decd25a-cb35-402e-bc26-a6a5d701bf1e) May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.403806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 15:42:59.405304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 15:42:59.406597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4f68295c-0898-4b56-88df-06d88f1c5881 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Returning 404 to user: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4f68295c-0898-4b56-88df-06d88f1c5881 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "DELETE /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 404 len: 109 microversion: 2.1 time: 0.039304 May 12 15:42:59.408123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 352/735] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:42:59 2022] DELETE /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:59.410377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1af0dc63-e6b7-4716-8f8e-4d5b2136b836 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Calling method '.version_select at 0x7f60d0574550>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:42:59.417204 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:59.419051 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:42:59.420963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d32a2335-ac8b-4151-a637-5de573ea92ff tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.188486 May 12 15:42:59.421695 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 384/736] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:42:59 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:42:59.438830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-1af0dc63-e6b7-4716-8f8e-4d5b2136b836 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] HTTP exception thrown: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1af0dc63-e6b7-4716-8f8e-4d5b2136b836 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Request method failure captured: May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 HTTP/1.1 May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSr7AW4pQz-nnQoD724IlYGjLIzu6f4HRkBtt6zFq0DrSV6feli2rrZxbpC1OslH3iCZQvLArQGKyITu6R1ISfOXuDMJCXlcCtaBsfCM553ppjekN7znmkih5OxlzJBzpNDJBUUQvBiee2bcIZW-qexLabNboNX1miGqHy7wt_nc00Q May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:42:59.441477 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_1481509f8db146b3a536cd54c966b113", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/1481509f8db146b3a536cd54c966b113"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/1481509f8db146b3a536cd54c966b113"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 1481509f8db146b3a536cd54c966b113 May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1114635216 May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: a64b3606c510413c92abc2593d3f3615 May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1114635216-project May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'a28cf4ef-bc29-4267-886a-a260b890add1'} May 12 15:42:59.443038 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. (HTTP 404) (Request-ID: req-06b0a57d-baf6-4d3b-b112-2c03346465c9) May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.443965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 15:42:59.445341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 15:42:59.446686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1af0dc63-e6b7-4716-8f8e-4d5b2136b836 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] Returning 404 to user: Volume a28cf4ef-bc29-4267-886a-a260b890add1 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1af0dc63-e6b7-4716-8f8e-4d5b2136b836 tempest-VolumesSnapshotsTestJSON-1114635216 tempest-VolumesSnapshotsTestJSON-1114635216-project] 10.222.0.89 "GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1" status: 404 len: 109 microversion: 2.1 time: 0.036595 May 12 15:42:59.448308 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 353/737] 10.222.0.89 () {58 vars in 1244 bytes} [Thu May 12 15:42:59 2022] GET /compute/v2.1/os-volumes/a28cf4ef-bc29-4267-886a-a260b890add1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:42:59.466873 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2465410-1e0c-4431-b959-eb4d590b2122"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:42:59.467936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:42:59.473779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:59.474222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:59.474975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:42:59.475399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:42:59.715373 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c616efd9-4ff3-4928-b95e-7c745bfecdf0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "POST /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252408 May 12 15:42:59.720722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 385/738] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:42:59 2022] POST /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:00.439521 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:00.440315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:00.446824 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:00.447269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:00.448031 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:00.448641 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:00.584505 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:00.592387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:00.593876 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:00.595043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-774b320a-0533-4ece-8d9c-b11c264539e9 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.159977 May 12 15:43:00.595597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 354/739] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:00 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:01.614998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:01.615590 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:01.623154 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:01.623607 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:01.624387 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:01.624862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:01.756719 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:01.765269 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:01.766739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:01.767963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9d1a3d02-7140-41a9-8052-7c4e7a4f77bd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.158335 May 12 15:43:01.768505 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 386/740] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:01 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:02.786914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:02.787730 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:02.796983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:02.797950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:02.798229 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:02.798666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:02.970364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:02.978551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:02.980126 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:02.981312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-737234c6-ad8a-4cd4-a984-601d72678a6d tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.198712 May 12 15:43:02.981881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 355/741] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:02 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:03.999725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:04.000324 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:04.006821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:04.007260 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:04.008053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:04.008493 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:04.142739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:04.150839 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:04.152318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:04.153543 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b6370c8b-a5af-46fd-af82-cf07be668239 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1742 microversion: 2.20 time: 0.157856 May 12 15:43:04.154315 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 387/742] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:03 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:05.171881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:05.172773 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:05.179372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:05.179825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:05.180612 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:05.181040 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:05.316878 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:05.325128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:05.330170 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:05.331560 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-baa2f676-f571-40a4-8dbd-25dc82ad7c22 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1742 microversion: 2.20 time: 0.164024 May 12 15:43:05.332159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 356/743] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:05 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:06.352239 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:06.353274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:06.361440 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:06.361893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:06.362663 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:06.363097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:06.508619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:06.518304 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:06.522707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:06.538414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b5d5d315-aedc-4120-94fa-b4f2555b8d9c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1742 microversion: 2.20 time: 0.181483 May 12 15:43:06.538414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 388/744] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:06 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:07.221236 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:07.222844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:07.229867 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.230323 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.231124 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.231555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.267462 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-189c749e-376d-4d33-bcd6-a07f5aa90f93 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050117 May 12 15:43:07.268708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 357/745] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:43:07 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:07.415793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:07.416693 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:07.423891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.424605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.425579 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.426009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.459040 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1fcbdcc2-96d3-4d89-859f-001e7c687119 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/d599ce51-a9c5-4a37-81a7-d862f070f5c2" status: 200 len: 194 microversion: 2.1 time: 0.047348 May 12 15:43:07.459628 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 389/746] 10.222.0.89 () {58 vars in 1412 bytes} [Thu May 12 15:43:07 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/d599ce51-a9c5-4a37-81a7-d862f070f5c2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:43:07.470602 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:07.470992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:07.477927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.478592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.479534 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.480123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.552349 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:07.553654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:07.560757 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.561399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.562358 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:07.562948 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:07.571439 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lazy-loading 'services' on Instance uuid 9539d8d8-5b0b-44e3-a8a4-869350bf75da {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:43:07.664948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-323bf8f3-9b12-4387-9a9f-5c11f1d53e74 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/d599ce51-a9c5-4a37-81a7-d862f070f5c2" status: 202 len: 0 microversion: 2.1 time: 0.199363 May 12 15:43:07.681862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 358/747] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:43:07 2022] DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/d599ce51-a9c5-4a37-81a7-d862f070f5c2 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 15:43:07.752580 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:07.768321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:07.770172 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:07.771733 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-398b1c41-4a22-4e7b-95da-9833ed4f72b4 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.229293 May 12 15:43:07.783565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 390/748] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:07 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:43:08.104028 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-6c5b6916-5e93-4db7-9fba-2b35177b40c8 req-c662d9f5-1278-4c68-ae1c-0164b6032fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "name": "network-vif-plugged", "status": "completed", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:08.112665 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-6c5b6916-5e93-4db7-9fba-2b35177b40c8 req-c662d9f5-1278-4c68-ae1c-0164b6032fee service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.113470 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-6c5b6916-5e93-4db7-9fba-2b35177b40c8 req-c662d9f5-1278-4c68-ae1c-0164b6032fee service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.127309 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-6c5b6916-5e93-4db7-9fba-2b35177b40c8 req-c662d9f5-1278-4c68-ae1c-0164b6032fee service nova] Creating event network-vif-plugged:6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f for instance 6089f367-763b-4daf-8849-37153b6e32f3 on hv-cinder-83588 May 12 15:43:08.132723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-6c5b6916-5e93-4db7-9fba-2b35177b40c8 req-c662d9f5-1278-4c68-ae1c-0164b6032fee service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033408 May 12 15:43:08.133706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 359/749] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:08.790315 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:08.791012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:08.807808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.808626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.809742 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.810450 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.812623 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:08.813386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:08.823681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.824386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.825502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.826132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.859547 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f7a48937-18f6-4484-a32a-6bd9b2b3020b tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/a2465410-1e0c-4431-b959-eb4d590b2122" status: 200 len: 194 microversion: 2.1 time: 0.052241 May 12 15:43:08.860578 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 360/750] 10.222.0.89 () {58 vars in 1412 bytes} [Thu May 12 15:43:08 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/a2465410-1e0c-4431-b959-eb4d590b2122 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:43:08.871171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:08.873261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:08.879760 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.880433 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.881488 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:08.882227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:08.982486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lazy-loading 'services' on Instance uuid 9539d8d8-5b0b-44e3-a8a4-869350bf75da {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:43:08.989904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:09.000112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:09.001928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:09.003156 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-14ef7669-ecb7-46ff-ae02-4656e33b6fe0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.216780 May 12 15:43:09.003730 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 391/751] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:08 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:09.063372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3ee803cb-3583-4122-b97f-b93ef2269ae3 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/a2465410-1e0c-4431-b959-eb4d590b2122" status: 202 len: 0 microversion: 2.1 time: 0.196157 May 12 15:43:09.063970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 361/752] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:43:08 2022] DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments/a2465410-1e0c-4431-b959-eb4d590b2122 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 15:43:10.022731 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:10.023352 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:10.035370 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.036022 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.036925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.037432 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.201236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:10.211603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:10.213273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:10.214898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-975547d7-7078-408a-a0ca-a066ac97e8e0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.197062 May 12 15:43:10.218836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 392/753] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:10 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:10.262766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:10.263988 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:10.270923 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.271666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.272782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.273450 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.307694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3322fe6c-c292-4b5e-811e-b584a8d295de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049638 May 12 15:43:10.313494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 362/754] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:43:10 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:43:10.455463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:10.456877 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:10.463170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.463864 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.464853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.465287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.502829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d1697e2d-4567-4b17-8e04-b2bc8837fcb0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051327 May 12 15:43:10.503732 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 393/755] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:43:10 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:43:10.605921 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:10.606351 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:10.613085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.613533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.615967 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.617803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.662975 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:43:10.769694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-850e01c4-3887-4076-b990-91af45bf01b0 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 204 len: 0 microversion: 2.1 time: 0.166805 May 12 15:43:10.771373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 363/756] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:43:10 2022] DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:43:10.780201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:10.780837 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:10.790292 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.791012 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.792060 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:10.793076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:10.945944 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:10.954414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-498ee752-0d49-428c-ac65-02b21a6e452c tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1673 microversion: 2.1 time: 0.178845 May 12 15:43:10.955241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 394/757] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:10 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:11.235373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:11.235654 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:11.241966 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:11.242537 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:11.243415 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:11.243955 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:11.405812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:11.414830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:11.418285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:11.419745 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a80dd1a7-6d65-47c2-bd0e-faa98c41e971 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.189546 May 12 15:43:11.430831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 364/758] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:11 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:11.971802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:11.973660 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:11.983027 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:11.983867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:11.985469 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:11.986125 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:12.143154 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:12.153040 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-dcc3b69a-6ba5-4d19-a4e1-04c284bc9c24 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1673 microversion: 2.1 time: 0.185536 May 12 15:43:12.160603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 395/759] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:11 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1673 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:12.438618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:12.439229 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:12.445980 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:12.446699 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:12.447878 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:12.448542 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:12.723863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:12.733160 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:12.734752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:12.735996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e79f7dd1-f242-4ea9-9ad2-3de1f6587848 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.301307 May 12 15:43:12.751587 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 365/760] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:12 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:13.177096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:13.177763 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:13.187688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:13.188143 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:13.188953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:13.189556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:13.377691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d68f67eb8949e0b0878527f86ee683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aba4b044dfa42cd8da55086ab774561', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:13.388181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1c63743c-09cb-48ed-9349-4bae1ccdb6bd tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 200 len: 1673 microversion: 2.1 time: 0.216533 May 12 15:43:13.389764 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 396/761] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:13 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:13.755512 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:13.756755 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:13.756890 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-79984a9e-523c-4361-8fc1-e6f6c7ce1fcc req-67d0b70d-b754-4da5-b729-a6fda20237a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9539d8d8-5b0b-44e3-a8a4-869350bf75da", "name": "network-vif-deleted", "tag": "750fc7fd-59de-40ae-8a72-66a1e13bbe2a"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:13.767648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:13.768385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:13.775267 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-79984a9e-523c-4361-8fc1-e6f6c7ce1fcc req-67d0b70d-b754-4da5-b729-a6fda20237a6 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:13.775712 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-79984a9e-523c-4361-8fc1-e6f6c7ce1fcc req-67d0b70d-b754-4da5-b729-a6fda20237a6 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:13.782002 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:13.783193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:13.796505 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-79984a9e-523c-4361-8fc1-e6f6c7ce1fcc req-67d0b70d-b754-4da5-b729-a6fda20237a6 service nova] Creating event network-vif-deleted:750fc7fd-59de-40ae-8a72-66a1e13bbe2a for instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da on hv-cinder-83588 May 12 15:43:13.810870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-79984a9e-523c-4361-8fc1-e6f6c7ce1fcc req-67d0b70d-b754-4da5-b729-a6fda20237a6 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055739 May 12 15:43:13.818691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 397/762] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:14.026844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:14.035411 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:14.037403 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:14.038705 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-45ba2ba3-bf99-47aa-8da9-72b8b86cac60 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.287163 May 12 15:43:14.050321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 366/763] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:13 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:14.407810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:14.408535 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:14.426274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:14.426896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:14.427791 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:14.428415 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:14.449188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] HTTP exception thrown: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Request method failure captured: May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da HTTP/1.1 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgGv2kq8w-fV7QqoD1hXhM8wu8rPG9lC6y3q5P-ChwwAYwuM6Ef743RKn4glbqTm_FOciQX_jtvzTbYjfi6ASqNb-RKnTshEeNNHzOUnrriREB-Yi03x9gBR9G0_6RPJnz0WFBFXkcsVxDqPpBN6RPpnA5zg2nH-jQvskJnLbOWM4 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:43:14.451347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8aba4b044dfa42cd8da55086ab774561", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 99d68f67eb8949e0b0878527f86ee683 May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:14.453126 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '9539d8d8-5b0b-44e3-a8a4-869350bf75da'} May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:43:14.454076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:14.455829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:14.458812 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Returning 404 to user: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:43:14.459917 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-47be4bbd-cf2f-47ab-aa55-9c4f4c9c8515 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 404 len: 111 microversion: 2.1 time: 0.057428 May 12 15:43:14.461061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 398/764] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:14 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:43:14.470239 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7c110e23-45af-4e0b-9a01-2c36c3a2e4de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '.version_select at 0x7f60d0563700>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:14.497085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7c110e23-45af-4e0b-9a01-2c36c3a2e4de tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185708159" status: 202 len: 0 microversion: 2.1 time: 0.030886 May 12 15:43:14.498440 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 367/765] 10.222.0.89 () {58 vars in 1217 bytes} [Thu May 12 15:43:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185708159 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:43:15.058233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:15.059327 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:15.070741 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:15.072097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:15.073048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:15.073476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:15.440890 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:15.450624 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:15.456867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:15.458071 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-831425a3-3fda-4af5-949e-4721ed7f132a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.404575 May 12 15:43:15.461069 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 399/766] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:15 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:15.479435 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:15.480016 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:15.493265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:15.493265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:15.493265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:15.493265 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:15.543460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lazy-loading 'flavor' on Instance uuid 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:43:15.694639 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ce895556-55fb-4b53-be3e-d7f42ab9c3dd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "POST /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa/action" status: 202 len: 0 microversion: 2.1 time: 0.220052 May 12 15:43:15.704936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:15.705918 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:15.708826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 368/767] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:43:15 2022] POST /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:43:15.732326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:15.737402 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:15.740423 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:15.741700 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:15.935129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:15.944240 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-eafd35ca-7a61-4eb0-bfc7-7cb1c9bc484d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.243910 May 12 15:43:15.954407 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 400/768] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:15 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:16.479552 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:16.480954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:16.491321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:16.492179 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:16.493210 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:16.493836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:16.674374 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:16.682920 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:16.685081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:16.686830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c4c872d2-55ce-470b-8587-7416d6f65302 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1737 microversion: 2.20 time: 0.211696 May 12 15:43:16.698036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 369/769] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:16 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:16.966163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:16.967670 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:16.978271 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:16.979119 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:16.980566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:16.981308 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.126242 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:17.133696 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b196e6f0-fc40-4bb6-b399-0077debf3da9 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.174755 May 12 15:43:17.134299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 401/770] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:16 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:17.705448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:17.706214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:17.712926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:17.713377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.714343 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:17.714938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.869621 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:17.870398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:17.876885 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:17.877567 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.878883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:17.879393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.893964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] HTTP exception thrown: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Request method failure captured: May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da HTTP/1.1 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgGv2kq8w-fV7QqoD1hXhM8wu8rPG9lC6y3q5P-ChwwAYwuM6Ef743RKn4glbqTm_FOciQX_jtvzTbYjfi6ASqNb-RKnTshEeNNHzOUnrriREB-Yi03x9gBR9G0_6RPJnz0WFBFXkcsVxDqPpBN6RPpnA5zg2nH-jQvskJnLbOWM4 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:43:17.895575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8aba4b044dfa42cd8da55086ab774561", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 99d68f67eb8949e0b0878527f86ee683 May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.897186 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '9539d8d8-5b0b-44e3-a8a4-869350bf75da'} May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:43:17.897964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.903046 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.904248 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Returning 404 to user: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:43:17.904248 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b9796d13-af21-4ddd-8aee-875414282a19 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 404 len: 111 microversion: 2.1 time: 0.031654 May 12 15:43:17.904248 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 402/771] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:43:17 2022] DELETE /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:43:17.906087 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:17.907385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: 9539d8d8-5b0b-44e3-a8a4-869350bf75da] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:17.913735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:17.914419 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.915950 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:17.916619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:17.932411 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] HTTP exception thrown: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Request method failure captured: May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da HTTP/1.1 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgGv2kq8w-fV7QqoD1hXhM8wu8rPG9lC6y3q5P-ChwwAYwuM6Ef743RKn4glbqTm_FOciQX_jtvzTbYjfi6ASqNb-RKnTshEeNNHzOUnrriREB-Yi03x9gBR9G0_6RPJnz0WFBFXkcsVxDqPpBN6RPpnA5zg2nH-jQvskJnLbOWM4 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:43:17.934173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8aba4b044dfa42cd8da55086ab774561", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 99d68f67eb8949e0b0878527f86ee683 May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.935854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '9539d8d8-5b0b-44e3-a8a4-869350bf75da'} May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:43:17.936893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. May 12 15:43:17.939093 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:17.940884 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Returning 404 to user: Instance 9539d8d8-5b0b-44e3-a8a4-869350bf75da could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:43:17.940884 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-00322d72-dc85-440d-a632-e3ca34d5eb41 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da" status: 404 len: 111 microversion: 2.1 time: 0.037231 May 12 15:43:17.941718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 403/772] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:17 2022] GET /compute/v2.1/servers/9539d8d8-5b0b-44e3-a8a4-869350bf75da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:43:17.955300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:17.966034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:17.967988 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:17.969618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ceb1f03e-924d-41c9-8725-92198f2f3139 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1719 microversion: 2.20 time: 0.268086 May 12 15:43:17.970756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 370/773] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:17 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1719 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:18.151282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:18.151988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:18.158365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:18.159050 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:18.159836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:18.160265 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:18.298830 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:18.306406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9b4b2335-a10e-4701-8bc3-6c9ddce05148 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.159478 May 12 15:43:18.306977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 404/774] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:18 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:18.988112 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:18.988882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:18.995058 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:18.995515 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:18.996294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:18.996756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.105184 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:19.106037 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:19.114062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:19.114974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.116081 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:19.116922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.135989 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] HTTP exception thrown: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Request method failure captured: May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 HTTP/1.1 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgGv2kq8w-fV7QqoD1hXhM8wu8rPG9lC6y3q5P-ChwwAYwuM6Ef743RKn4glbqTm_FOciQX_jtvzTbYjfi6ASqNb-RKnTshEeNNHzOUnrriREB-Yi03x9gBR9G0_6RPJnz0WFBFXkcsVxDqPpBN6RPpnA5zg2nH-jQvskJnLbOWM4 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:43:19.137998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8aba4b044dfa42cd8da55086ab774561", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 99d68f67eb8949e0b0878527f86ee683 May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.139559 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'be73f585-3978-4a35-b794-ccafc28dd120'} May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:43:19.140492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.142599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.144816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Returning 404 to user: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:43:19.146838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-8f3bbc25-2851-4a95-a594-a66ed9955f18 tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 404 len: 111 microversion: 2.1 time: 0.046882 May 12 15:43:19.150027 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:19.151283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 405/775] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:43:19 2022] DELETE /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:43:19.156127 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:19.156778 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] [instance: be73f585-3978-4a35-b794-ccafc28dd120] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:19.157958 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:19.159634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:19.161019 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-eda6019f-917b-46ff-8d6d-ff8263176d7e tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1719 microversion: 2.20 time: 0.176863 May 12 15:43:19.161574 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 371/776] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:18 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:19.163228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:19.163686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.164565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:19.165001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.179406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] HTTP exception thrown: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Request method failure captured: May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 HTTP/1.1 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgGv2kq8w-fV7QqoD1hXhM8wu8rPG9lC6y3q5P-ChwwAYwuM6Ef743RKn4glbqTm_FOciQX_jtvzTbYjfi6ASqNb-RKnTshEeNNHzOUnrriREB-Yi03x9gBR9G0_6RPJnz0WFBFXkcsVxDqPpBN6RPpnA5zg2nH-jQvskJnLbOWM4 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:43:19.181004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8aba4b044dfa42cd8da55086ab774561", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8aba4b044dfa42cd8da55086ab774561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8aba4b044dfa42cd8da55086ab774561 May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1015473642 May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 99d68f67eb8949e0b0878527f86ee683 May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeTestJSON-1015473642-project May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.182384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'be73f585-3978-4a35-b794-ccafc28dd120'} May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:43:19.183223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. May 12 15:43:19.184816 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:43:19.186207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] Returning 404 to user: Instance be73f585-3978-4a35-b794-ccafc28dd120 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:43:19.186207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-83e6c1dc-abac-4e46-bf1a-ac042a5620ff tempest-AttachVolumeTestJSON-1015473642 tempest-AttachVolumeTestJSON-1015473642-project] 10.222.0.89 "GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120" status: 404 len: 111 microversion: 2.1 time: 0.030142 May 12 15:43:19.186207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 406/777] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:19 2022] GET /compute/v2.1/servers/be73f585-3978-4a35-b794-ccafc28dd120 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:43:19.323358 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:19.324237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:19.330562 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:19.330921 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.331920 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:19.332350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:19.615933 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:19.624530 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-800f4574-2e6a-4fab-8511-747d5515264c tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.305151 May 12 15:43:19.625103 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 372/778] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:19 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:20.179896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:20.181619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:20.192350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:20.193603 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:20.194409 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:20.194860 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:20.641158 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:20.641807 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:20.649084 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:20.649753 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:20.650842 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:20.651451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:20.754252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:20.764241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:20.766382 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:20.767978 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7d55ce62-de5c-4bbb-80d7-a298357a9084 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1662 microversion: 2.20 time: 0.592664 May 12 15:43:20.768725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 407/779] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:20 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1662 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:43:20.786965 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c003297-bec7-44fb-a480-5550a13c3d74"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:20.788176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:20.795550 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:20.796314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:20.797212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:20.797758 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:20.958614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:20.968725 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9551625d-ba0f-49de-bf37-8d780abf2166 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.331275 May 12 15:43:20.970432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 373/780] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:20 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:43:21.136975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ab7cff8b-ac12-4adb-a9f1-3b930f2a82ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353907 May 12 15:43:21.137616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 408/781] 10.222.0.89 () {62 vars in 1363 bytes} [Thu May 12 15:43:20 2022] POST /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-volume_attachments => generated 188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 15:43:21.255126 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:21.255748 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:21.261857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.262491 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:21.263761 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.265077 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:21.554732 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c1e6f431-1400-43d2-8bf8-41315c54e12a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-volume_attachments/7c003297-bec7-44fb-a480-5550a13c3d74" status: 202 len: 0 microversion: 2.20 time: 0.303518 May 12 15:43:21.556130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 374/782] 10.222.0.89 () {60 vars in 1456 bytes} [Thu May 12 15:43:21 2022] DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-volume_attachments/7c003297-bec7-44fb-a480-5550a13c3d74 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 12 15:43:21.624969 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:21.625891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:21.635111 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.636017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:21.637004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.637726 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:21.750404 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-286704d9-4cb7-44ae-82ec-2e77a9304e5c tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "POST /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/action" status: 202 len: 0 microversion: 2.20 time: 0.130644 May 12 15:43:21.752681 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 409/783] 10.222.0.89 () {62 vars in 1318 bytes} [Thu May 12 15:43:21 2022] POST /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 15:43:21.763055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:21.763698 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:21.774690 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.775447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:21.776454 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.777148 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:21.947201 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:21.955442 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:21.957009 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:21.958220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-43c3c8a9-5b81-489c-a740-56123a695b33 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1670 microversion: 2.20 time: 0.201535 May 12 15:43:21.958754 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 375/784] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:21 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1670 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:43:21.989070 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:21.990116 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:21.997242 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:21.997706 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:22.004416 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:22.005138 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:22.173652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-1148e323-001b-44c7-9157-c31c5c27b52d req-64c6758b-7035-451f-8bf4-5b67a808fbdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "name": "network-vif-unplugged", "status": "completed", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:22.183286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-1148e323-001b-44c7-9157-c31c5c27b52d req-64c6758b-7035-451f-8bf4-5b67a808fbdd service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:22.183736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-1148e323-001b-44c7-9157-c31c5c27b52d req-64c6758b-7035-451f-8bf4-5b67a808fbdd service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:22.199757 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.compute.server_external_events [req-1148e323-001b-44c7-9157-c31c5c27b52d req-64c6758b-7035-451f-8bf4-5b67a808fbdd service nova] Unable to find a host for instance 6089f367-763b-4daf-8849-37153b6e32f3. Dropping event network-vif-unplugged {{(pid=123633) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 15:43:22.201116 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-1148e323-001b-44c7-9157-c31c5c27b52d req-64c6758b-7035-451f-8bf4-5b67a808fbdd service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032894 May 12 15:43:22.202879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 376/785] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 12 15:43:22.251761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:22.261852 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b134782d-b4ad-4976-8856-e4a0ee90f86d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.277295 May 12 15:43:22.268516 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 410/786] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:21 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:22.985763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:22.987881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:22.996991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:22.997539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:22.999176 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:22.999679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:23.281912 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:23.282902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:23.290741 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:23.291221 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:23.291991 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:23.292806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:23.323885 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:23.333783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:23.335554 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:23.337239 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b4690a73-243e-47f4-bc6f-95ee3dbdb8d6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.364066 May 12 15:43:23.338122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 377/787] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:22 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:23.621196 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:23.628802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b32ac794-d981-43ee-9def-9f18fa56b958 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.351410 May 12 15:43:23.629610 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 411/788] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:23 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:43:24.356171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:24.357075 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:24.363608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:24.363964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:24.364765 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:24.365193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:24.514692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:24.523283 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:24.525093 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:24.526826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-376cc270-72e1-4dd3-b85f-2cae9e72f4d3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.175274 May 12 15:43:24.527922 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 378/789] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:24 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:24.656905 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:24.657891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:24.671301 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:24.672721 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:24.673834 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:24.675107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:24.922047 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:24.933478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5d3e7ae5-c6d5-47cd-aa4f-678e8e697bad tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.290323 May 12 15:43:24.945442 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 412/790] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:24 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:25.545895 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:25.547083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:25.553942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:25.554394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:25.555358 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:25.555806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:25.818644 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:25.839920 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:25.841910 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:25.843394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-90359a60-06b8-4476-abe3-fe7b1244b154 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.301861 May 12 15:43:25.854207 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 379/791] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:25 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:25.950762 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:25.951364 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:25.965339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:25.965833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:25.966629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:25.967062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:26.237508 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:26.246276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7f97ede4-85e6-4a23-986d-868e70972992 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.299466 May 12 15:43:26.247208 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 413/792] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:25 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:26.862767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:26.863430 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:26.876810 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:26.877275 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:26.878323 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:26.878994 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:27.267717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:27.272671 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:27.280494 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:27.281415 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:27.282380 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:27.282973 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:27.718351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:27.735999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-67af49b4-a3e0-4b85-ba16-bfdb434d5c65 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.476107 May 12 15:43:27.737600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 414/793] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:27 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:27.741157 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:27.749549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:27.751248 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:27.769337 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8aac0a21-c4b0-40be-a2f6-c18c9a2012b2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.894169 May 12 15:43:27.770233 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 380/794] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:26 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:28.758101 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:28.759038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:28.775664 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:28.777107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:28.780090 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:28.783919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:28.792603 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:28.795311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:28.819666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:28.819666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:28.819666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:28.819666 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:29.189828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:29.196600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:29.204070 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:29.204511 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d9532c94-f39d-4a3c-b635-864fdf0f4275 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.452897 May 12 15:43:29.205123 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 415/795] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:28 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:29.207814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:29.209780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a521bbfb-c486-4af4-ae6c-542453bf648a tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.424784 May 12 15:43:29.210962 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 381/796] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:28 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:30.222021 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:30.223545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:30.228448 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:30.229108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:30.236135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:30.236776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:30.237700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:30.238982 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:30.239463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:30.239981 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:30.244347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:30.244975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:30.654799 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:30.665306 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1e1ddb63-c655-428f-b97c-2b50ac1442b1 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.447308 May 12 15:43:30.668849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 382/797] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:30 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:30.747896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:30.761461 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:30.769756 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:30.771365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5c3634ee-0cae-4257-a10a-9937cddc1558 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.547280 May 12 15:43:30.772167 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 416/798] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:30 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:31.685583 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:31.686174 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:31.703063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:31.703427 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:31.704545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:31.705171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:31.799619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:31.800280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:31.815415 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:31.815878 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:31.828378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:31.828893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:32.571203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:32.582769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-355124bc-970d-4f43-8382-a35c1695b6cd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.901003 May 12 15:43:32.586261 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 383/799] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:31 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:32.606322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:32.645581 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:32.648787 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:32.651408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-076c5b97-ddc8-4460-bdd7-44e05361aae0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.855506 May 12 15:43:32.652019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 417/800] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:31 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 15:43:33.192095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0420c6f4-832f-46b6-96d6-96183c23c911 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: .version_select at 0x7f60d05d3af0>, body: {"keypair": {"name": "tempest-keypair-77331668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESZeJVv4zzEacRXmZQMEl8bhQjzbmSYP0JNhYi3MDqS72HtMT1K3qp34jsM/hhNV1iyFTtnivFycYK+PiZ5mhTqFzHAXkBbNqM3Yj4+1NDvOeZ814bNnRrrM0qpBQ255g=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:33.206231 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-0420c6f4-832f-46b6-96d6-96183c23c911 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:43:33.210107 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-0420c6f4-832f-46b6-96d6-96183c23c911 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:43:33.254616 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0420c6f4-832f-46b6-96d6-96183c23c911 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.183071 May 12 15:43:33.255231 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 384/801] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:43:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:33.599256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:33.599906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:33.611002 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:33.611749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:33.612853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:33.615497 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:33.672935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:33.673845 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:33.685494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:33.689790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:33.690611 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:33.692700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:33.926203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:33.934055 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5d3c81af-2e5a-4f8a-b3b9-6e0d5e4729f7 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.338686 May 12 15:43:33.934722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 418/802] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:33 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:33.983503 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:33.991889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:33.993981 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:33.996950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-10f8f4ef-5b4f-4fc9-be78-0839a54cb8b0 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.329181 May 12 15:43:33.999516 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 385/803] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:33 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:34.945028 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1753081193", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28e8ac92-f000-41cc-98c0-a6392dfdb29f"}], "security_groups": [{"name": "tempest-securitygroup--1311225603"}], "key_name": "tempest-keypair-77331668", "user_data": "}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:34.950535 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:34.951153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:34.958914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:34.959364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:34.960353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:34.960965 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:35.117150 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] validate_networks() for [('28e8ac92-f000-41cc-98c0-a6392dfdb29f', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:43:35.184736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:35.193283 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4a034345-6aa5-490b-a8c7-89e2428c525a tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.246566 May 12 15:43:35.204181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 386/804] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:34 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:35.209153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:35.210130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:35.220663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:35.221102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:35.222347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:35.222785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:35.736791 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:35.748820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:35.750501 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:35.753657 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-353c7eeb-48a8-418f-80e4-3d682b5770e6 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.548219 May 12 15:43:35.754601 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 387/805] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:35 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:36.056402 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:43:36.056975 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:43:36.057253 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:43:36.057654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:43:36.058062 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:43:36.082735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.085357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.086495 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.089236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.117454 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:43:36.122112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:43:36.137088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:43:36.140236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:43:36.211319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b06d0375-c558-4785-9f4e-b6dadfafb74f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.270669 May 12 15:43:36.211661 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:36.212283 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:36.213399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 419/806] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:43:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:43:36.222553 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.225973 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a7bcb035-3c14-4d10-ac42-5083cd0ba0b1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:36.226906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a7bcb035-3c14-4d10-ac42-5083cd0ba0b1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:36.227123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.230350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.232417 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.337323 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a7bcb035-3c14-4d10-ac42-5083cd0ba0b1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:36.345274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a7bcb035-3c14-4d10-ac42-5083cd0ba0b1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1240 microversion: 2.1 time: 0.124828 May 12 15:43:36.346868 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 420/807] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:36 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1240 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:36.525185 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:36.535119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5a3710c7-6e56-4124-805d-67f14fbad936 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1569 microversion: 2.1 time: 0.328403 May 12 15:43:36.535677 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 388/808] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:36 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1569 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:43:36.561052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:36.561883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:36.570375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.571413 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.572331 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.573547 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.696582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c2bfb933-8a6b-4f1d-bd21-780701bf79ff tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "POST /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa/action" status: 202 len: 0 microversion: 2.1 time: 0.144819 May 12 15:43:36.699167 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 421/809] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:43:36 2022] POST /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 15:43:36.711087 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:36.711854 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:36.730706 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.730860 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.732776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.733162 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.774602 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:36.775217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:36.785481 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.785943 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:36.786812 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:36.789831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:37.176748 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:37.197035 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4f71f079-b2a8-470b-96a7-bdb08a5d0377 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1517 microversion: 2.1 time: 0.490916 May 12 15:43:37.200221 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 389/810] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:36 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1517 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:37.229830 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:37.245627 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:37.248451 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:37.255892 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-aa8c08bc-4fdc-4f04-8582-a76d43c9c8fc tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.484425 May 12 15:43:37.259600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 422/811] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:36 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:37.362645 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:37.363865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:37.375203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:37.376202 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:37.377800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:37.378676 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:37.456688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:37.468501 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-fb65ce4d-0802-45fa-b3f2-00a62d13c872 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1292 microversion: 2.1 time: 0.109713 May 12 15:43:37.469251 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 390/812] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:37 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1292 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:38.216782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:38.216782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:38.225638 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.226098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.227390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.227834 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.254724 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-856fa81a-78bd-4ec5-aa49-1886910840ef req-1836a09b-5335-42a3-a880-fdf262b783a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "name": "network-vif-plugged", "status": "completed", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:38.270105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-856fa81a-78bd-4ec5-aa49-1886910840ef req-1836a09b-5335-42a3-a880-fdf262b783a2 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.272864 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-856fa81a-78bd-4ec5-aa49-1886910840ef req-1836a09b-5335-42a3-a880-fdf262b783a2 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.294503 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-856fa81a-78bd-4ec5-aa49-1886910840ef req-1836a09b-5335-42a3-a880-fdf262b783a2 service nova] Creating event network-vif-plugged:6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f for instance 6089f367-763b-4daf-8849-37153b6e32f3 on hv-cinder-83588 May 12 15:43:38.301263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-856fa81a-78bd-4ec5-aa49-1886910840ef req-1836a09b-5335-42a3-a880-fdf262b783a2 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050063 May 12 15:43:38.302392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 391/813] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:43:38.308192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:38.310159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:38.347345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.349836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.352264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.356138 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.454478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:38.463699 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cf7c35b0-2e71-47dd-bd15-963b3a892bfc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1519 microversion: 2.1 time: 0.252739 May 12 15:43:38.464883 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 423/814] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:38 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:38.486636 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:38.487584 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:38.495230 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.495761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.496914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:38.497734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:38.706942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:38.722686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:38.724178 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:38.725381 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3362f0d4-94cf-44d2-8948-62b9f58ea0ae tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.421634 May 12 15:43:38.725953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 392/815] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:38 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:38.794023 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:38.805522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-59595ef7-45f6-424d-a30f-2bd1ec5a586a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.323106 May 12 15:43:38.806140 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 424/816] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:38 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:39.481658 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:39.482364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:39.489270 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.489723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:39.490508 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.491117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:39.699645 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-0648c2a4-d737-4bd9-9389-b586a75f3d96 req-85e7c3c0-debf-45b8-8a87-063ca17fa5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e13bb6c-6990-4d32-b530-1e11c5125c6b", "tag": "ecd06b96-36fb-4e9d-ace0-023a0cc7db72"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:39.715556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-0648c2a4-d737-4bd9-9389-b586a75f3d96 req-85e7c3c0-debf-45b8-8a87-063ca17fa5bf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.716255 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-0648c2a4-d737-4bd9-9389-b586a75f3d96 req-85e7c3c0-debf-45b8-8a87-063ca17fa5bf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:39.732084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-0648c2a4-d737-4bd9-9389-b586a75f3d96 req-85e7c3c0-debf-45b8-8a87-063ca17fa5bf service nova] Creating event network-changed:ecd06b96-36fb-4e9d-ace0-023a0cc7db72 for instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b on hv-cinder-83588 May 12 15:43:39.742317 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-0648c2a4-d737-4bd9-9389-b586a75f3d96 req-85e7c3c0-debf-45b8-8a87-063ca17fa5bf service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047045 May 12 15:43:39.743489 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 425/817] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:39.759014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:39.759716 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:39.767239 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.767695 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:39.769124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.769575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:39.810860 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:39.821653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5ccd563b-a8bc-4b4b-be10-e1cbe1c3a5db tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.343868 May 12 15:43:39.831948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 393/818] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:39 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:39.837223 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:39.838042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:39.848390 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.849110 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:39.850117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:39.850724 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:40.014314 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:40.028277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:40.031348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:40.033930 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-23f052a9-3231-42f9-9f25-12ef71905d84 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1728 microversion: 2.20 time: 0.280422 May 12 15:43:40.034514 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 426/819] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:39 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1728 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:40.128011 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:40.136529 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-393e9b79-32ff-4e2a-80de-7f96bbd09f07 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.303089 May 12 15:43:40.137447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 394/820] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:39 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:40.345295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-4aebe93a-3b1d-4566-a30f-52431154f059 req-1d9fa61a-6726-4a07-b367-e03f2e946a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "name": "network-vif-unplugged", "status": "completed", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:40.354793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4aebe93a-3b1d-4566-a30f-52431154f059 req-1d9fa61a-6726-4a07-b367-e03f2e946a92 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:40.355249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-4aebe93a-3b1d-4566-a30f-52431154f059 req-1d9fa61a-6726-4a07-b367-e03f2e946a92 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:40.371908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-4aebe93a-3b1d-4566-a30f-52431154f059 req-1d9fa61a-6726-4a07-b367-e03f2e946a92 service nova] Creating event network-vif-unplugged:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:43:40.377507 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-4aebe93a-3b1d-4566-a30f-52431154f059 req-1d9fa61a-6726-4a07-b367-e03f2e946a92 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036719 May 12 15:43:40.379083 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 427/821] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:43:40.839900 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:40.840632 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:40.846749 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:40.847203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:40.847996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:40.848434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:41.014311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:41.021925 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-566179f1-e73c-47bd-82d1-963d55d5a8cf tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.186455 May 12 15:43:41.022495 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 395/822] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:40 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:41.053444 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:41.054146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:41.061385 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:41.061858 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:41.063845 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:41.063845 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:41.153340 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:41.153953 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:41.160100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:41.160592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:41.161369 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:41.161807 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:41.196038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:41.204607 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:41.206201 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:41.207595 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-02d0a2f7-f533-4e97-9ac4-624e9a678ba7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1715 microversion: 2.20 time: 0.158476 May 12 15:43:41.208185 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 428/823] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:43:41 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:43:41.288402 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:41.296769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-99cfecec-1283-4a9b-8918-9bb57d6bcd51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.147161 May 12 15:43:41.297342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 396/824] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:41 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:42.039332 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:42.039939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:42.046802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:42.047249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:42.048014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:42.048441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:42.244337 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:42.252524 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7f09f00f-1066-46d2-bd5b-ec85b43024b6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.217075 May 12 15:43:42.253109 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 429/825] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:42 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:42.316089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:42.317061 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:42.326843 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:42.327334 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:42.328117 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:42.328582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:42.457897 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:42.465502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f400853c-62e6-4548-9164-2f59558d1e64 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.155303 May 12 15:43:42.466069 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 397/826] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:42 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:43.274394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:43.275362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:43.286995 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:43.287760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:43.289113 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:43.289847 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:43.421544 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:43.431779 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4b152775-e11a-4e3c-90d9-228448270e54 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.164037 May 12 15:43:43.432577 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 430/827] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:43 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:43.482056 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:43.482665 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:43.489480 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:43.489929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:43.490695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:43.491099 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:43.636063 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:43.651578 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-403f5866-3f0c-435a-9924-3f5e810b6b9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.173116 May 12 15:43:43.652929 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 398/828] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:43 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:44.450097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:44.450683 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:44.457911 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:44.458414 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:44.459305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:44.459794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:44.590431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:44.597831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a51fd6ac-9539-49a7-8154-876cc97b2fdc tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.152320 May 12 15:43:44.598728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 431/829] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:44 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:44.675096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:44.675977 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:44.685550 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:44.686240 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:44.687417 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:44.688081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:45.103830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:45.111436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c3ba153a-0912-46f1-9df2-c10b4567eec4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.441610 May 12 15:43:45.112015 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 399/830] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:44 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:43:45.618198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:45.619158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:45.627927 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:45.628375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:45.629190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:45.629631 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:45.772147 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:45.780148 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e8a71dbf-cc78-4991-85c4-20f6e85c141e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.168581 May 12 15:43:45.780844 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 432/831] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:45 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:46.137074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:46.138056 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:46.145739 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:46.146188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:46.146969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:46.147400 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:46.279899 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:46.287906 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-701d1606-41f8-4685-8283-90f63d1138b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.157168 May 12 15:43:46.288497 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 400/832] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:46 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:46.293836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-a7e9e013-c421-493e-9a3a-f730f7bdd6ca req-35b6bcc6-a0b6-4828-b753-3385b1812ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e13bb6c-6990-4d32-b530-1e11c5125c6b", "name": "network-vif-plugged", "status": "completed", "tag": "ecd06b96-36fb-4e9d-ace0-023a0cc7db72"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:46.301809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-a7e9e013-c421-493e-9a3a-f730f7bdd6ca req-35b6bcc6-a0b6-4828-b753-3385b1812ac4 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:46.302249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-a7e9e013-c421-493e-9a3a-f730f7bdd6ca req-35b6bcc6-a0b6-4828-b753-3385b1812ac4 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:46.313399 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-a7e9e013-c421-493e-9a3a-f730f7bdd6ca req-35b6bcc6-a0b6-4828-b753-3385b1812ac4 service nova] Creating event network-vif-plugged:ecd06b96-36fb-4e9d-ace0-023a0cc7db72 for instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b on hv-cinder-83588 May 12 15:43:46.318309 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-a7e9e013-c421-493e-9a3a-f730f7bdd6ca req-35b6bcc6-a0b6-4828-b753-3385b1812ac4 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029152 May 12 15:43:46.318948 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 433/833] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:46.800073 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:46.800626 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:46.808129 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:46.808816 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:46.809857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:46.810702 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:46.943304 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:46.951202 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-bc42078c-d9af-41dc-9a17-e1e314f2596e tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.155993 May 12 15:43:46.951783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 401/834] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:46 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:47.310256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:47.311401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:47.318398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:47.318874 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:47.319629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:47.320061 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:47.456723 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:47.464145 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-011877f5-6893-431c-913c-e6f7845591d4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1366 microversion: 2.1 time: 0.161870 May 12 15:43:47.464753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 434/835] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:47 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:47.968939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:47.969673 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:47.976773 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:47.977247 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:47.978234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:47.978755 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:48.112772 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:48.120234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-288aeb96-2a33-4459-820b-ad6c2f808e7d tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.155684 May 12 15:43:48.120836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 402/836] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:47 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:48.482945 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:48.483891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:48.490639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:48.491133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:48.491912 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:48.492350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:48.627247 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:48.634811 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1c964cbb-33b1-4cb3-b937-5f682070d175 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1557 microversion: 2.1 time: 0.155919 May 12 15:43:48.635384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 435/837] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:48 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:48.651364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:48.651852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:48.658227 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:48.658688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:48.659447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:48.659842 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:48.734916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c05b6650-128d-424f-9b06-5228e58688df tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087309 May 12 15:43:48.735490 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 403/838] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:43:48 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:49.138191 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:49.139310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:49.149260 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:49.149701 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:49.150482 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:49.150906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:49.288433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:49.296936 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-57f4c840-f584-424d-8274-5c9cd426a89b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.162914 May 12 15:43:49.297517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 436/839] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:49 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:50.152753 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-0ceb2f4f-2515-41a1-8aef-37e5db4c2187 req-a23c13fd-eb79-49dd-a32a-64c7d3bfa492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e13bb6c-6990-4d32-b530-1e11c5125c6b", "tag": "ecd06b96-36fb-4e9d-ace0-023a0cc7db72"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:50.160978 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-0ceb2f4f-2515-41a1-8aef-37e5db4c2187 req-a23c13fd-eb79-49dd-a32a-64c7d3bfa492 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:50.161435 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-0ceb2f4f-2515-41a1-8aef-37e5db4c2187 req-a23c13fd-eb79-49dd-a32a-64c7d3bfa492 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:50.175821 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-0ceb2f4f-2515-41a1-8aef-37e5db4c2187 req-a23c13fd-eb79-49dd-a32a-64c7d3bfa492 service nova] Creating event network-changed:ecd06b96-36fb-4e9d-ace0-023a0cc7db72 for instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b on hv-cinder-83588 May 12 15:43:50.180950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-0ceb2f4f-2515-41a1-8aef-37e5db4c2187 req-a23c13fd-eb79-49dd-a32a-64c7d3bfa492 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209065 May 12 15:43:50.181544 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 404/840] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:50.314180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:50.314852 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:50.321390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:50.321809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:50.322752 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:50.323354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:50.490783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-c51b2218-89d8-43da-b7c4-f9184cebedaa req-cb0d6da1-7ee0-44b4-95c1-938145e310cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "name": "network-vif-plugged", "status": "completed", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:43:50.499242 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-c51b2218-89d8-43da-b7c4-f9184cebedaa req-cb0d6da1-7ee0-44b4-95c1-938145e310cc service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:50.500204 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-c51b2218-89d8-43da-b7c4-f9184cebedaa req-cb0d6da1-7ee0-44b4-95c1-938145e310cc service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:50.512708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-c51b2218-89d8-43da-b7c4-f9184cebedaa req-cb0d6da1-7ee0-44b4-95c1-938145e310cc service nova] Creating event network-vif-plugged:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:43:50.518517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-c51b2218-89d8-43da-b7c4-f9184cebedaa req-cb0d6da1-7ee0-44b4-95c1-938145e310cc service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 May 12 15:43:50.519786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 405/841] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:43:50.541615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:50.552393 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-80e50ea5-dbf6-4363-980f-f5567a1476d3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.242059 May 12 15:43:50.557873 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 437/842] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:50 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:51.572065 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:51.572785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:51.579812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:51.580259 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:51.581050 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:51.581483 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:51.726310 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:51.734389 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8dba85b1-7851-413f-9fdd-1b47ac5325df tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1575 microversion: 2.1 time: 0.167047 May 12 15:43:51.734974 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 406/843] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:51 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:43:52.756132 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:43:52.757192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:43:52.767033 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:52.767486 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:52.768257 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:43:52.768757 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:43:52.909381 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:43:52.920850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-af4668c9-9941-4962-9b1d-1c821542e0b3 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1562 microversion: 2.1 time: 0.171012 May 12 15:43:52.921530 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 438/844] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:43:52 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:14.021005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:14.021918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:14.029100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:14.029549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:14.030335 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:14.030771 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:14.061458 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3e14043f-8cf5-4337-a154-5595e22eb0c2 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046606 May 12 15:44:14.061971 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 407/845] 10.222.0.89 () {60 vars in 1342 bytes} [Thu May 12 15:44:14 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:14.121444 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:14.122002 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:14.129023 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:14.129472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:14.130246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:14.130704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:14.156671 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:44:14.236125 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-97c7d0c3-c2bd-4ad7-a112-a37db07579ca tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 204 len: 0 microversion: 2.20 time: 0.118098 May 12 15:44:14.236788 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 439/846] 10.222.0.89 () {60 vars in 1279 bytes} [Thu May 12 15:44:14 2022] DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 15:44:14.247983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:14.248591 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:14.257014 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:14.257456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:14.258220 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:14.258635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:14.396792 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:14.405160 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:14.406653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:14.407813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-09c26bc8-e9f5-4f2a-8533-dc0ea710a76b tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.165715 May 12 15:44:14.408375 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 408/847] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:44:14 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:44:15.433479 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:15.434615 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:15.444268 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:15.444758 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:15.445534 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:15.445964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:15.582783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:15.591182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:15.592679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:15.593829 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1b17f5df-d1f0-416f-bbbd-89bec39c18b7 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1721 microversion: 2.20 time: 0.169202 May 12 15:44:15.594421 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 440/848] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:44:15 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:44:16.608924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-163f9cc1-f91b-4a0f-8609-f671b68ee6f8 req-0269b65b-726c-4a2a-ae9f-d655574f08b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6089f367-763b-4daf-8849-37153b6e32f3", "name": "network-vif-deleted", "tag": "6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:16.611088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:16.611689 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:16.619245 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-163f9cc1-f91b-4a0f-8609-f671b68ee6f8 req-0269b65b-726c-4a2a-ae9f-d655574f08b0 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:16.619806 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-163f9cc1-f91b-4a0f-8609-f671b68ee6f8 req-0269b65b-726c-4a2a-ae9f-d655574f08b0 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:16.621357 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:16.622058 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:16.623017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:16.623805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:16.636191 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-163f9cc1-f91b-4a0f-8609-f671b68ee6f8 req-0269b65b-726c-4a2a-ae9f-d655574f08b0 service nova] Creating event network-vif-deleted:6d6c1687-0cc5-4b29-bc75-1c7f890d1e6f for instance 6089f367-763b-4daf-8849-37153b6e32f3 on hv-cinder-83588 May 12 15:44:16.652879 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-163f9cc1-f91b-4a0f-8609-f671b68ee6f8 req-0269b65b-726c-4a2a-ae9f-d655574f08b0 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047443 May 12 15:44:16.654510 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 409/849] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:16.697568 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:16.710441 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:16.716152 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ee73f971f9844c85bd9b29749554dc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d51f9d06bb148ecb297dcacdc8b0b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:16.717438 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9bcf9bd9-397e-4ef8-875a-ec6f798764fd tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 200 len: 1654 microversion: 2.20 time: 0.110251 May 12 15:44:16.718347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 441/850] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:44:16 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 1654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 15:44:17.738035 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:17.738733 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:17.745586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:17.746042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:17.746813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:17.747312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:17.761042 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] HTTP exception thrown: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Request method failure captured: May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 HTTP/1.1 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSmgxVuLB0b-yfEGINHfGJRbmuU6GfCy3L4PknuEXeyVETqyRo0wGFo7GstnccY02BYplHIE8dv5olN7iXqRnp4xKx-Z6vUHD_l-82PSwNtPzlpxLt4p_o1QK3gc5vfIfKOvlI1A-zAWQir2JR0R6h6TtRbLcwmidMfliMXOGdfb4xs May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Openstack-Nova-Api-Version: 2.20 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:44:17.762691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7d51f9d06bb148ecb297dcacdc8b0b32", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ee73f971f9844c85bd9b29749554dc37 May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:17.764432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '6089f367-763b-4daf-8849-37153b6e32f3'} May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:44:17.765338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:17.766947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:17.768299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Returning 404 to user: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:44:17.768299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-24d12545-b69d-45ee-9e96-f9a753d054e3 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 404 len: 111 microversion: 2.20 time: 0.031001 May 12 15:44:17.768299 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 410/851] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:44:17 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 15:44:17.773271 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bd6adaed-88c3-42c3-9258-7d02ddd4da92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '.version_select at 0x7f60d604d4c0>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:17.793674 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bd6adaed-88c3-42c3-9258-7d02ddd4da92 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163988253" status: 204 len: 0 microversion: 2.20 time: 0.024245 May 12 15:44:17.794209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 442/852] 10.222.0.89 () {60 vars in 1261 bytes} [Thu May 12 15:44:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163988253 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 15:44:19.556809 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:19.557322 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:19.563984 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:19.564432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:19.565226 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:19.565659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:19.579404 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] HTTP exception thrown: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Request method failure captured: May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 HTTP/1.1 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSmgxVuLB0b-yfEGINHfGJRbmuU6GfCy3L4PknuEXeyVETqyRo0wGFo7GstnccY02BYplHIE8dv5olN7iXqRnp4xKx-Z6vUHD_l-82PSwNtPzlpxLt4p_o1QK3gc5vfIfKOvlI1A-zAWQir2JR0R6h6TtRbLcwmidMfliMXOGdfb4xs May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Openstack-Nova-Api-Version: 2.20 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:44:19.580916 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7d51f9d06bb148ecb297dcacdc8b0b32", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ee73f971f9844c85bd9b29749554dc37 May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.582494 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '6089f367-763b-4daf-8849-37153b6e32f3'} May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:44:19.584029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.585802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:19.587487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Returning 404 to user: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:44:19.587487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-83425ff1-46c3-4aae-b6f0-7967ad8ad4d5 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 404 len: 111 microversion: 2.20 time: 0.029430 May 12 15:44:19.587487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 411/853] 10.222.0.89 () {60 vars in 1279 bytes} [Thu May 12 15:44:19 2022] DELETE /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 15:44:19.591244 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:19.591853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 6089f367-763b-4daf-8849-37153b6e32f3] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:19.599505 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:19.599961 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:19.600789 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:19.601223 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:19.614668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] HTTP exception thrown: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Request method failure captured: May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 HTTP/1.1 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgxVuLB0b-yfEGINHfGJRbmuU6GfCy3L4PknuEXeyVETqyRo0wGFo7GstnccY02BYplHIE8dv5olN7iXqRnp4xKx-Z6vUHD_l-82PSwNtPzlpxLt4p_o1QK3gc5vfIfKOvlI1A-zAWQir2JR0R6h6TtRbLcwmidMfliMXOGdfb4xs May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Openstack-Nova-Api-Version: 2.20 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:44:19.616339 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7d51f9d06bb148ecb297dcacdc8b0b32", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ee73f971f9844c85bd9b29749554dc37 May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.617977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '6089f367-763b-4daf-8849-37153b6e32f3'} May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:44:19.618848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. May 12 15:44:19.620306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:19.621620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Returning 404 to user: Instance 6089f367-763b-4daf-8849-37153b6e32f3 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:44:19.621620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3d8a8620-bf2e-4a23-8ae9-2465c8b692f8 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3" status: 404 len: 111 microversion: 2.20 time: 0.030510 May 12 15:44:19.621620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 443/854] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:44:19 2022] GET /compute/v2.1/servers/6089f367-763b-4daf-8849-37153b6e32f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 15:44:20.760631 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:20.761125 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:20.767844 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:20.768291 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:20.769115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:20.769539 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:20.783502 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] HTTP exception thrown: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Request method failure captured: May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb HTTP/1.1 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSmgxVuLB0b-yfEGINHfGJRbmuU6GfCy3L4PknuEXeyVETqyRo0wGFo7GstnccY02BYplHIE8dv5olN7iXqRnp4xKx-Z6vUHD_l-82PSwNtPzlpxLt4p_o1QK3gc5vfIfKOvlI1A-zAWQir2JR0R6h6TtRbLcwmidMfliMXOGdfb4xs May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Openstack-Nova-Api-Version: 2.20 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:44:20.785034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7d51f9d06bb148ecb297dcacdc8b0b32", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ee73f971f9844c85bd9b29749554dc37 May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.786686 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '0a406a83-d33b-40db-adb0-9789902c45cb'} May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:44:20.787695 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.789200 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:44:20.790651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Returning 404 to user: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:44:20.790651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-f7bb0de6-6d70-4e1b-a716-2742b6603271 tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 404 len: 111 microversion: 2.20 time: 0.029781 May 12 15:44:20.790651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 412/855] 10.222.0.89 () {60 vars in 1279 bytes} [Thu May 12 15:44:20 2022] DELETE /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 15:44:20.795433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:20.796052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] [instance: 0a406a83-d33b-40db-adb0-9789902c45cb] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:20.802842 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:20.803319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:20.804090 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:20.804672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:20.818273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] HTTP exception thrown: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Request method failure captured: May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb HTTP/1.1 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSmgxVuLB0b-yfEGINHfGJRbmuU6GfCy3L4PknuEXeyVETqyRo0wGFo7GstnccY02BYplHIE8dv5olN7iXqRnp4xKx-Z6vUHD_l-82PSwNtPzlpxLt4p_o1QK3gc5vfIfKOvlI1A-zAWQir2JR0R6h6TtRbLcwmidMfliMXOGdfb4xs May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Openstack-Nova-Api-Version: 2.20 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:44:20.819821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7d51f9d06bb148ecb297dcacdc8b0b32", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7d51f9d06bb148ecb297dcacdc8b0b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7d51f9d06bb148ecb297dcacdc8b0b32 May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1664728569 May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ee73f971f9844c85bd9b29749554dc37 May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1664728569-project May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.821503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '0a406a83-d33b-40db-adb0-9789902c45cb'} May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:44:20.822412 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. May 12 15:44:20.823893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:44:20.825251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] Returning 404 to user: Instance 0a406a83-d33b-40db-adb0-9789902c45cb could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:44:20.825251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-21327c31-3010-48cc-9cb8-3e06951441ad tempest-AttachVolumeShelveTestJSON-1664728569 tempest-AttachVolumeShelveTestJSON-1664728569-project] 10.222.0.89 "GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb" status: 404 len: 111 microversion: 2.20 time: 0.030120 May 12 15:44:20.825251 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 444/856] 10.222.0.89 () {60 vars in 1276 bytes} [Thu May 12 15:44:20 2022] GET /compute/v2.1/servers/0a406a83-d33b-40db-adb0-9789902c45cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 15:44:26.362518 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-224083695", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546602223", "security_groups": [{"name": "tempest-secgroup-smoke-1255422790"}], "block_device_mapping_v2": [{"uuid": "de7f0507-0176-442f-9c65-a652f1282d46", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "869afb1f-8f08-43d2-8b78-38d5d6f40548"}]}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:26.494593 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] validate_networks() for [('869afb1f-8f08-43d2-8b78-38d5d6f40548', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:44:26.498207 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:26.498710 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:26.509893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:26.510350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:26.511376 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:26.511993 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:26.545022 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7b5f655b-2121-4189-87f3-07dd2fdc0017 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/ips" status: 200 len: 151 microversion: 2.1 time: 0.050584 May 12 15:44:26.545624 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 445/857] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:44:26 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:44:26.921438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:44:26.921835 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:44:26.922312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:44:26.922722 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:44:26.923135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:44:26.931830 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:26.932286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:26.933377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:26.933851 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:26.952634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for project 4b8824725a894bbcb17789008292c1e4. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:44:26.957252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Getting quotas for user 73bfb098d5f04da9adb7ae1d30fd30b1 and project 4b8824725a894bbcb17789008292c1e4. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:44:27.015090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:44:27.017476 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de7f0507-0176-442f-9c65-a652f1282d46',volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:44:27.144381 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a5358fde-49d2-4874-a7d1-80707295f7e3 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.787789 May 12 15:44:27.145048 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 413/858] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:44:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:44:27.155485 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3f2762d2-3698-40f3-a8cf-fdcbe385fe6e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:27.156129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3f2762d2-3698-40f3-a8cf-fdcbe385fe6e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:27.214752 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3f2762d2-3698-40f3-a8cf-fdcbe385fe6e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:27.221908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3f2762d2-3698-40f3-a8cf-fdcbe385fe6e tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1094 microversion: 2.1 time: 0.070085 May 12 15:44:27.222672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 446/859] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:27 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:27.947089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:27.948228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:27.954469 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:27.954932 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:27.955709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:27.956145 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:28.217096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a5ea86f4-9c72-4b39-b573-3c4b1a1ed21d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274430 May 12 15:44:28.222437 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 414/860] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:44:27 2022] POST /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:28.239248 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:28.239856 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:28.254888 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:28.255662 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:28.256728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:28.258103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:28.353285 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:28.360939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f05ce4b6-3204-4d2e-ae35-1ac69b49c3ae tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1210 microversion: 2.1 time: 0.125700 May 12 15:44:28.361511 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 447/861] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:28 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:29.379674 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:29.380347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:29.387329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:29.387784 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:29.388747 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:29.389191 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:29.600187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:29.608105 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-07e36851-541e-498c-a8fb-68f61881508b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.233266 May 12 15:44:29.608683 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 415/862] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:29 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:29.944014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-b56b8409-128b-467f-89b6-2abbc9907104 req-3a9dc256-c131-4bdb-af9c-f22dd9739ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63d43ec-7046-4884-b2b8-c3ece839bd3c", "tag": "aae4bb46-71ca-4a34-b515-03e88e478136"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:29.953667 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-b56b8409-128b-467f-89b6-2abbc9907104 req-3a9dc256-c131-4bdb-af9c-f22dd9739ec5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:29.954217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-b56b8409-128b-467f-89b6-2abbc9907104 req-3a9dc256-c131-4bdb-af9c-f22dd9739ec5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:29.973611 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-b56b8409-128b-467f-89b6-2abbc9907104 req-3a9dc256-c131-4bdb-af9c-f22dd9739ec5 service nova] Creating event network-changed:aae4bb46-71ca-4a34-b515-03e88e478136 for instance e63d43ec-7046-4884-b2b8-c3ece839bd3c on hv-cinder-83588 May 12 15:44:29.979010 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-b56b8409-128b-467f-89b6-2abbc9907104 req-3a9dc256-c131-4bdb-af9c-f22dd9739ec5 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038586 May 12 15:44:29.979979 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 448/863] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:30.629368 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:30.630386 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:30.638127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:30.638692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:30.639587 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:30.640145 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:30.851540 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:30.859352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-52a31dbe-9f36-4d6c-b642-3230924abcb0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.236538 May 12 15:44:30.860100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 416/864] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:30 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:31.876979 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:31.877746 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:31.886707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:31.887455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:31.888647 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:31.889294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:32.028282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:32.035687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-db9f7530-0080-45df-aeb3-e48bf982cfb2 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.163767 May 12 15:44:32.036508 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 449/865] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:31 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:33.053919 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:33.054530 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:33.061429 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:33.061874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:33.062636 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:33.063208 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:33.202297 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:33.210185 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-205ff6b9-25b8-4e35-8be4-6fabdf63522a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.160115 May 12 15:44:33.210769 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 417/866] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:33 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:34.227408 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:34.228138 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:34.234729 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:34.235288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:34.236158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:34.236682 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:34.399930 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:34.411236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-27dc0726-528b-4ed8-a46d-d691b7efac93 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.187665 May 12 15:44:34.411810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 450/867] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:34 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:35.430369 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:35.430999 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:35.437577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:35.438025 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:35.438813 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:35.439248 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:35.569173 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:35.576826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c7916f21-251e-4179-b7b4-927190021c1f tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.150379 May 12 15:44:35.577403 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 418/868] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:35 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:35.748802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-78989d74-354c-4ce1-b196-df0ff18b5ce2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: .version_select at 0x7f60d604d280>, body: {"keypair": {"name": "tempest-keypair-620193684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvbmEIIxfuCdSZ3YTZltfAL6jK1z9GV9iW/Zv6Xfft16khlVrxNm26SxfiN8fePVK4L9JU3mOBVK1wXKxo4ZKru1E+3Iv0gX9G4NcB0eizwfwNwpo0Tz47QggF+MK8chA=="}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:35.763024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-78989d74-354c-4ce1-b196-df0ff18b5ce2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:44:35.766939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-78989d74-354c-4ce1-b196-df0ff18b5ce2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:44:35.790622 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-78989d74-354c-4ce1-b196-df0ff18b5ce2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045779 May 12 15:44:35.791222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 451/869] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:44:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:36.595373 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:36.596032 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:36.602756 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:36.603214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:36.604204 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:36.604692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:36.818745 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:36.829664 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cc74c217-acda-46b5-9247-a544c5f1af0b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.239002 May 12 15:44:36.830567 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 419/870] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:36 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:37.187686 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469273050", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28e8ac92-f000-41cc-98c0-a6392dfdb29f"}], "security_groups": [{"name": "tempest-securitygroup--1347761110"}], "key_name": "tempest-keypair-620193684", "user_data": "}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:37.295974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] validate_networks() for [('28e8ac92-f000-41cc-98c0-a6392dfdb29f', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:44:37.784498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:44:37.785079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:44:37.785633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:44:37.786265 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:44:37.786821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:44:37.797299 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:37.797751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:37.798553 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:37.798989 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:37.815803 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:44:37.820040 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:44:37.831249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:44:37.833591 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:44:37.846371 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:37.847249 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:37.854388 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:37.855121 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:37.856654 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:37.857095 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:37.881144 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-84eedd1d-cf6a-4578-ad06-4ff6fe27a4ec tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.698346 May 12 15:44:37.881894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 452/871] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:44:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 15:44:37.892116 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7670c410-ec78-4f37-873c-4a09715f32d7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:37.893219 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7670c410-ec78-4f37-873c-4a09715f32d7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:37.984659 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7670c410-ec78-4f37-873c-4a09715f32d7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:38.024391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7670c410-ec78-4f37-873c-4a09715f32d7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1241 microversion: 2.1 time: 0.136351 May 12 15:44:38.027641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 453/872] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:37 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:38.071451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:38.079586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-caeb92f3-4f5b-4f3b-8ffe-f512ad549861 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.237105 May 12 15:44:38.080174 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 420/873] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:37 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:39.041546 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:39.042492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:39.049702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:39.050160 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:39.050943 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:39.051383 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:39.097106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:39.098432 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:39.106300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:39.107109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:39.108128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:39.108805 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:39.134049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:39.146366 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-76626b6e-d060-40c6-9ca8-ace863202fad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1299 microversion: 2.1 time: 0.108705 May 12 15:44:39.147284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 454/874] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:39 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:39.315699 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:39.324742 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6aa4479e-5bff-4e12-994b-f33cdc5ca170 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.231895 May 12 15:44:39.325474 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 421/875] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:39 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:44:40.163749 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:40.164361 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:40.171224 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:40.171863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:40.172859 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:40.173563 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:40.342381 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:40.343144 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:40.350958 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:40.351421 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:40.352211 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:40.352692 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:40.380818 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:40.390427 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4ff383f4-27c7-4587-bea7-9333a8690e73 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.230378 May 12 15:44:40.391959 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 455/876] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:40 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:44:40.555949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-965ddc0c-fdc1-4a5a-a1d8-7f41d6aa87be req-12104a84-000b-4c82-a06f-db5b08f4189d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf1ffc3-df70-42c7-96e5-b0cca1228030", "tag": "4781445c-fe84-4283-9e97-a037fbad647b"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:40.569289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-965ddc0c-fdc1-4a5a-a1d8-7f41d6aa87be req-12104a84-000b-4c82-a06f-db5b08f4189d service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:40.570504 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-965ddc0c-fdc1-4a5a-a1d8-7f41d6aa87be req-12104a84-000b-4c82-a06f-db5b08f4189d service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:40.585007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:40.597900 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-965ddc0c-fdc1-4a5a-a1d8-7f41d6aa87be req-12104a84-000b-4c82-a06f-db5b08f4189d service nova] Creating event network-changed:4781445c-fe84-4283-9e97-a037fbad647b for instance daf1ffc3-df70-42c7-96e5-b0cca1228030 on hv-cinder-83588 May 12 15:44:40.605312 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-965ddc0c-fdc1-4a5a-a1d8-7f41d6aa87be req-12104a84-000b-4c82-a06f-db5b08f4189d service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052049 May 12 15:44:40.607988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 456/877] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:40.609622 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-fc510a10-76a7-4a54-8ad8-a097d4b43188 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.269082 May 12 15:44:40.610781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 422/878] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:40 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:44:40.799783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-b61061fd-2997-45a4-a78f-0b6ab2aeaee6 req-09255228-d521-4555-bc40-a8e8c7c7afe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63d43ec-7046-4884-b2b8-c3ece839bd3c", "name": "network-vif-plugged", "status": "completed", "tag": "aae4bb46-71ca-4a34-b515-03e88e478136"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:40.808256 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-b61061fd-2997-45a4-a78f-0b6ab2aeaee6 req-09255228-d521-4555-bc40-a8e8c7c7afe3 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:40.808727 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-b61061fd-2997-45a4-a78f-0b6ab2aeaee6 req-09255228-d521-4555-bc40-a8e8c7c7afe3 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:40.821833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-b61061fd-2997-45a4-a78f-0b6ab2aeaee6 req-09255228-d521-4555-bc40-a8e8c7c7afe3 service nova] Creating event network-vif-plugged:aae4bb46-71ca-4a34-b515-03e88e478136 for instance e63d43ec-7046-4884-b2b8-c3ece839bd3c on hv-cinder-83588 May 12 15:44:40.826818 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-b61061fd-2997-45a4-a78f-0b6ab2aeaee6 req-09255228-d521-4555-bc40-a8e8c7c7afe3 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 May 12 15:44:40.827549 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 457/879] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:44:41.408329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:41.408944 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:41.415785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:41.416234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:41.417415 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:41.417829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:41.554939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:41.563089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5440e002-e2fe-4824-8246-fc69f6a3bed8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.158289 May 12 15:44:41.563776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 423/880] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:41 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:41.630040 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:41.630748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:41.637019 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:41.637474 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:41.638249 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:41.638687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:41.780583 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:41.788080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-27ae0f80-add0-4c1f-b930-86c4041d848a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.164203 May 12 15:44:41.788718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 458/881] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:41 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:42.580387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:42.581037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:42.587864 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:42.588314 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:42.589116 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:42.589551 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:42.783942 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:42.792333 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-862df1ef-1f71-4deb-a168-276309ece0e2 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.215403 May 12 15:44:42.792924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 424/882] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:42 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:42.805521 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:42.806394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:42.813445 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:42.813906 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:42.814690 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:42.815133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:42.957828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:42.966487 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-939d10d1-c8ea-4ea6-b71b-ad9a69174058 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1266 microversion: 2.1 time: 0.164803 May 12 15:44:42.967410 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 459/883] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:42 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:43.808789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:43.809441 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:43.817161 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:43.817602 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:43.818391 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:43.818856 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:43.984211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:43.984942 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:43.991032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:43.991486 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:43.992281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:43.992740 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:44.010555 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:44.018887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ae342f48-72dc-442a-8145-e8da6a783444 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.214024 May 12 15:44:44.028532 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 425/884] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:43 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:44.290065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:44.298220 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2e0ec1df-830f-43ab-b147-ad571b730e8b tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1452 microversion: 2.1 time: 0.318723 May 12 15:44:44.299163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 460/885] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:43 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1452 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:44.315252 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:44.315875 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:44.322130 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:44.322577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:44.323338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:44.323767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:44.457143 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:44.464735 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-800536ea-a7dc-41b9-a6b2-93f87c06587c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1452 microversion: 2.1 time: 0.153497 May 12 15:44:44.465311 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 426/886] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:44 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:45.047147 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:45.048394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:45.056863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:45.057623 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:45.058832 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:45.059464 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:45.237831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:45.245986 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3548af1d-a0b5-4efd-acd6-eb9c3a57455c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.207927 May 12 15:44:45.246642 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 461/887] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:45 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:46.263329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:46.263947 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:46.271106 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:46.271577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:46.272346 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:46.273006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:46.413096 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:46.421196 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2ed765f0-481b-472e-879d-31b55d16ca0a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.161812 May 12 15:44:46.422286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 427/888] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:46 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:46.656049 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-8b926d39-561f-4287-b210-dce30db6309f req-4bf26745-60ba-49ad-af99-24f8a334f81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63d43ec-7046-4884-b2b8-c3ece839bd3c", "tag": "aae4bb46-71ca-4a34-b515-03e88e478136"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:46.667218 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8b926d39-561f-4287-b210-dce30db6309f req-4bf26745-60ba-49ad-af99-24f8a334f81f service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:46.667669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-8b926d39-561f-4287-b210-dce30db6309f req-4bf26745-60ba-49ad-af99-24f8a334f81f service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:46.679236 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-8b926d39-561f-4287-b210-dce30db6309f req-4bf26745-60ba-49ad-af99-24f8a334f81f service nova] Creating event network-changed:aae4bb46-71ca-4a34-b515-03e88e478136 for instance e63d43ec-7046-4884-b2b8-c3ece839bd3c on hv-cinder-83588 May 12 15:44:46.686042 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-8b926d39-561f-4287-b210-dce30db6309f req-4bf26745-60ba-49ad-af99-24f8a334f81f service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033753 May 12 15:44:46.686604 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 462/889] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:46.801467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-551347af-687e-49cc-9e92-6cb57585167a req-2b05704f-642f-40e4-9ca4-31c0b99f6346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf1ffc3-df70-42c7-96e5-b0cca1228030", "name": "network-vif-plugged", "status": "completed", "tag": "4781445c-fe84-4283-9e97-a037fbad647b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:46.810055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-551347af-687e-49cc-9e92-6cb57585167a req-2b05704f-642f-40e4-9ca4-31c0b99f6346 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:46.810770 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-551347af-687e-49cc-9e92-6cb57585167a req-2b05704f-642f-40e4-9ca4-31c0b99f6346 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:46.832055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-551347af-687e-49cc-9e92-6cb57585167a req-2b05704f-642f-40e4-9ca4-31c0b99f6346 service nova] Creating event network-vif-plugged:4781445c-fe84-4283-9e97-a037fbad647b for instance daf1ffc3-df70-42c7-96e5-b0cca1228030 on hv-cinder-83588 May 12 15:44:46.838037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-551347af-687e-49cc-9e92-6cb57585167a req-2b05704f-642f-40e4-9ca4-31c0b99f6346 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040106 May 12 15:44:46.839332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 428/890] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:44:47.439014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:47.439822 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:47.446278 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:47.446797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:47.447826 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:47.448228 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:47.584725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:47.592817 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b95ae684-4d75-4358-a8a3-5d182bf93bcc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1367 microversion: 2.1 time: 0.158033 May 12 15:44:47.593403 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 463/891] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:47 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:48.610329 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:48.611025 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:48.618237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:48.618683 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:48.619646 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:48.620052 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:48.767029 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:44:48.777027 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-38d96b79-9cd6-4d00-9fe8-d44ef6af2248 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1557 microversion: 2.1 time: 0.170951 May 12 15:44:48.777610 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 429/892] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:44:48 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:44:48.793762 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:44:48.794284 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:44:48.801735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:48.802372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:48.803551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:48.804208 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:48.884830 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b5a0718d-afcd-49de-9e64-c20bb89b5763 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095300 May 12 15:44:48.885401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 464/893] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:44:48 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:44:49.886608 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-304cae9c-7a53-4907-bae4-df47040be34a req-fd061354-eb60-460d-9b1a-43cf16c5c5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf1ffc3-df70-42c7-96e5-b0cca1228030", "tag": "4781445c-fe84-4283-9e97-a037fbad647b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:44:49.895131 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-304cae9c-7a53-4907-bae4-df47040be34a req-fd061354-eb60-460d-9b1a-43cf16c5c5bc service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:44:49.895568 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-304cae9c-7a53-4907-bae4-df47040be34a req-fd061354-eb60-460d-9b1a-43cf16c5c5bc service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:44:49.906852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-304cae9c-7a53-4907-bae4-df47040be34a req-fd061354-eb60-460d-9b1a-43cf16c5c5bc service nova] Creating event network-changed:4781445c-fe84-4283-9e97-a037fbad647b for instance daf1ffc3-df70-42c7-96e5-b0cca1228030 on hv-cinder-83588 May 12 15:44:49.912076 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-304cae9c-7a53-4907-bae4-df47040be34a req-fd061354-eb60-460d-9b1a-43cf16c5c5bc service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029229 May 12 15:44:49.912691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 430/894] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:13.048291 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-467e98b2-e76e-4ef9-9240-dd93714de8bb req-427699f5-b736-4a5c-8439-581b9fe1fb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:13.049146 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:13.050036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:13.057332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-467e98b2-e76e-4ef9-9240-dd93714de8bb req-427699f5-b736-4a5c-8439-581b9fe1fb49 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:13.057779 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-467e98b2-e76e-4ef9-9240-dd93714de8bb req-427699f5-b736-4a5c-8439-581b9fe1fb49 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:13.058784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:13.059425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:13.060396 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:13.060920 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:13.069036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-467e98b2-e76e-4ef9-9240-dd93714de8bb req-427699f5-b736-4a5c-8439-581b9fe1fb49 service nova] Creating event network-changed:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:45:13.074375 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-467e98b2-e76e-4ef9-9240-dd93714de8bb req-427699f5-b736-4a5c-8439-581b9fe1fb49 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030743 May 12 15:45:13.078085 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 431/895] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:13.088174 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:45:13.214296 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4f925f7c-c50f-4703-8b98-b7997f0f7c19 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "DELETE /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 204 len: 0 microversion: 2.1 time: 0.173524 May 12 15:45:13.215198 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 465/896] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:45:13 2022] DELETE /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:45:13.230760 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:13.231465 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:13.238296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:13.238737 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:13.239752 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:13.240380 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:13.661726 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:13.670030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-974c1f23-2570-49e9-b9c0-02b61654ce7b tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.450341 May 12 15:45:13.670963 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 432/897] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:13 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:14.691974 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:14.693133 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:14.703354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:14.704098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:14.705431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:14.706158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:14.847661 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:14.860200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c8554b34-a3eb-4351-bc39-353719e1ff91 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.175000 May 12 15:45:14.861169 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 466/898] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:14 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:15.885153 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:15.886245 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:15.894134 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:15.894619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:15.895392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:15.895828 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:16.032974 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:16.045129 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d5653988-2437-41f6-b789-2601f98e86d6 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1568 microversion: 2.1 time: 0.166177 May 12 15:45:16.045936 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 433/899] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:15 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:17.067474 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:17.068088 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:17.074847 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:17.075378 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:17.076157 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:17.076661 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:17.284786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:17.295447 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-90e12afc-fc24-4385-aecc-60e3bb733251 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1449 microversion: 2.1 time: 0.231979 May 12 15:45:17.296053 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 467/900] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:17 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1449 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:17.482127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-96a1be7e-87a6-4718-8d5f-3f96a737eac2 req-77a0863e-a880-4f88-b16c-7752b62a0952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa", "name": "network-vif-deleted", "tag": "946a866f-f0df-4b44-ac4a-c0421cf05a34"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:17.491183 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-96a1be7e-87a6-4718-8d5f-3f96a737eac2 req-77a0863e-a880-4f88-b16c-7752b62a0952 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:17.491714 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-96a1be7e-87a6-4718-8d5f-3f96a737eac2 req-77a0863e-a880-4f88-b16c-7752b62a0952 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:17.503059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-96a1be7e-87a6-4718-8d5f-3f96a737eac2 req-77a0863e-a880-4f88-b16c-7752b62a0952 service nova] Creating event network-vif-deleted:946a866f-f0df-4b44-ac4a-c0421cf05a34 for instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa on hv-cinder-83588 May 12 15:45:17.508545 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-96a1be7e-87a6-4718-8d5f-3f96a737eac2 req-77a0863e-a880-4f88-b16c-7752b62a0952 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030295 May 12 15:45:17.509520 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 434/901] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:18.313221 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:18.313997 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:18.321303 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:18.321864 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:18.322738 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:18.323183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:18.390782 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a61ad9366b5845b5bbf8e8e1fdb649e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e085f63cf59c49a2847cbf228d7e609c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:18.400079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-a828f30f-4f4f-4ed7-8d2a-c81adbf3b50f tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 200 len: 1220 microversion: 2.1 time: 0.090870 May 12 15:45:18.400764 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 468/902] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:18 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:19.418857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:19.419556 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] [instance: 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:19.427738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:19.428257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:19.429071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:19.429504 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:19.443673 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] HTTP exception thrown: Instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa could not be found. May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Request method failure captured: May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa HTTP/1.1 May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSpJ3JrtFWhrgmJLWK5xHqrlmy56SKRyBxHJx8Cg9xVvyqs5uGpRQlFXhEJc3CuIitjjrI9s3kwOdd0yNXAZIJSVbCX1U12-PivimO7aL1b2naPqDEcYbbUoFnsmpm1I08gxLdBXX7QLn0bzVjvEhQ_uhsrC1jT-2JiggOQkDnm8iB8 May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: e085f63cf59c49a2847cbf228d7e609c May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-TestShelveInstance-1940577712 May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:45:19.445486 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_e085f63cf59c49a2847cbf228d7e609c", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/e085f63cf59c49a2847cbf228d7e609c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/e085f63cf59c49a2847cbf228d7e609c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/e085f63cf59c49a2847cbf228d7e609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-TestShelveInstance-1940577712 May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: e085f63cf59c49a2847cbf228d7e609c May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-TestShelveInstance-1940577712 May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-TestShelveInstance-1940577712-project May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: a61ad9366b5845b5bbf8e8e1fdb649e6 May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-TestShelveInstance-1940577712-project May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa could not be found. May 12 15:45:19.446954 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa'} May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa could not be found. May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:45:19.447803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa could not be found. May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa could not be found. May 12 15:45:19.449193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:45:19.450359 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Returning 404 to user: Instance 5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:45:19.450359 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6c63e76c-8dc0-49bd-827d-d384ba01bcfd tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa" status: 404 len: 111 microversion: 2.1 time: 0.033165 May 12 15:45:19.450767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 435/903] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:19 2022] GET /compute/v2.1/servers/5b31874f-f0a5-4a3d-a9a6-3bbb7f22cefa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:45:19.615409 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-9779b8b0-690a-4f4c-9011-05c2d1fa6827 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] Calling method '.version_select at 0x7f60d0c8c4c0>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:19.636733 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-9779b8b0-690a-4f4c-9011-05c2d1fa6827 tempest-TestShelveInstance-1940577712 tempest-TestShelveInstance-1940577712-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1369134100" status: 202 len: 0 microversion: 2.1 time: 0.025045 May 12 15:45:19.637545 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 469/904] 10.222.0.89 () {58 vars in 1253 bytes} [Thu May 12 15:45:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1369134100 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:45:36.606763 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:36.607684 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:36.615618 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.616076 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.616887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.617353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.642685 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-80a570be-78ed-4b9d-8b8f-cf4dc39e6320 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/ips" status: 200 len: 150 microversion: 2.1 time: 0.042440 May 12 15:45:36.643242 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 436/905] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:45:36 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:36.654478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:36.655533 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:36.662505 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.662950 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.663704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.664137 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.742467 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Invalid volume: volume bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d is already attached to instances: 0e13bb6c-6990-4d32-b530-1e11c5125c6b May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: POST /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/os-volume_attachments HTTP/1.1 May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 74 May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:45:36.744200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {"volumeAttachment": {"volumeId": "bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d"}} May 12 15:45:36.745914 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Invalid volume: volume bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d is already attached to instances: 0e13bb6c-6990-4d32-b530-1e11c5125c6b May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'server_id': 'daf1ffc3-df70-42c7-96e5-b0cca1228030', 'body': {'volumeAttachment': {'volumeId': 'bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d'}}} May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d is already attached to instances: 0e13bb6c-6990-4d32-b530-1e11c5125c6b May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:36.746831 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d is already attached to instances: 0e13bb6c-6990-4d32-b530-1e11c5125c6b May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:36.748282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d is already attached to instances: 0e13bb6c-6990-4d32-b530-1e11c5125c6b May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 400 to user: Invalid volume: volume bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d is already attached to instances: 0e13bb6c-6990-4d32-b530-1e11c5125c6b {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-27cd2b4e-b179-4545-b5bb-172fbcadfafb tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095808 May 12 15:45:36.749626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 470/906] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:45:36 2022] POST /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 15:45:36.754671 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:36.755192 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:36.762024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.762476 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.763238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.763669 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.788460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:45:36.875738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5fe660df-2917-4a96-8c44-f20b78a80041 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 204 len: 0 microversion: 2.1 time: 0.124487 May 12 15:45:36.876364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 437/907] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:45:36 2022] DELETE /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:45:36.885608 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:36.886242 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:36.893190 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.893692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:36.894477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:36.894901 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:37.035155 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:37.043882 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3843d774-868e-44b7-8f9b-97804dd46c4f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1682 microversion: 2.1 time: 0.162224 May 12 15:45:37.044381 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 471/908] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:36 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:38.066439 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:38.067659 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:38.078679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:38.079147 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:38.079948 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:38.080383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:38.229102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:38.238737 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8692aac2-e12c-4e32-bfd4-f272209e5aef tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1682 microversion: 2.1 time: 0.179705 May 12 15:45:38.239277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 438/909] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:38 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:39.260005 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:39.260748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:39.267628 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:39.268082 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:39.268881 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:39.269334 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:39.336070 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:39.343581 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3caba4a9-71d8-4212-809a-7bb794b05c5f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 200 len: 1614 microversion: 2.1 time: 0.087437 May 12 15:45:39.344181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 472/910] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:39 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:39.516307 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-819d48b7-1bac-4920-9aca-760c31e8a135 req-c16d7399-3964-487e-bb8c-3698ade8ad61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf1ffc3-df70-42c7-96e5-b0cca1228030", "name": "network-vif-deleted", "tag": "4781445c-fe84-4283-9e97-a037fbad647b"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:39.527255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-819d48b7-1bac-4920-9aca-760c31e8a135 req-c16d7399-3964-487e-bb8c-3698ade8ad61 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:39.527688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-819d48b7-1bac-4920-9aca-760c31e8a135 req-c16d7399-3964-487e-bb8c-3698ade8ad61 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:39.542802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-819d48b7-1bac-4920-9aca-760c31e8a135 req-c16d7399-3964-487e-bb8c-3698ade8ad61 service nova] Creating event network-vif-deleted:4781445c-fe84-4283-9e97-a037fbad647b for instance daf1ffc3-df70-42c7-96e5-b0cca1228030 on hv-cinder-83588 May 12 15:45:39.547958 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-819d48b7-1bac-4920-9aca-760c31e8a135 req-c16d7399-3964-487e-bb8c-3698ade8ad61 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 May 12 15:45:39.548669 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 439/911] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:40.361277 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:40.361853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:40.368486 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:40.368981 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:40.369746 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:40.370174 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:40.386100 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 HTTP/1.1 May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:45:40.387614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:45:40.389311 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'daf1ffc3-df70-42c7-96e5-b0cca1228030'} May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:45:40.390168 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:45:40.391555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:40.392828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:45:40.392828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3c14e38d-bfa9-49c3-a695-34d8e4a959b4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 404 len: 111 microversion: 2.1 time: 0.031772 May 12 15:45:40.392828 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 473/912] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:40 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:45:40.399101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e2eb096d-be5f-4f68-9eb3-de29976a82a8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '.version_select at 0x7f60d0563a60>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:40.418863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e2eb096d-be5f-4f68-9eb3-de29976a82a8 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620193684" status: 202 len: 0 microversion: 2.1 time: 0.023879 May 12 15:45:40.419427 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 440/913] 10.222.0.89 () {58 vars in 1217 bytes} [Thu May 12 15:45:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620193684 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 15:45:41.079530 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:41.080038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:41.086080 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:41.086540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:41.087322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:41.087760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:41.168739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lazy-loading 'services' on Instance uuid 0e13bb6c-6990-4d32-b530-1e11c5125c6b {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:45:41.250905 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7a0471bf-1a74-4c52-a675-9373acd5456e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments/bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d" status: 202 len: 0 microversion: 2.1 time: 0.174614 May 12 15:45:41.251735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 474/914] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:45:41 2022] DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments/bf1e23d0-a6ce-4919-a8e9-686efe0c9c7d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:45:41.262272 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:41.263313 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:41.270470 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:41.270918 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:41.271860 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:41.272547 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:41.303043 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-91bb51b2-5d1e-4844-ac87-173216df7406 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 May 12 15:45:41.306926 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 441/915] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:45:41 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:42.319059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:42.320395 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:42.328521 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:42.329153 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:42.330101 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:42.330637 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:42.362800 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-2a2fa2f1-6164-47cf-bca6-1da9740c60fd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050170 May 12 15:45:42.363368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 475/916] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:45:42 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:45:42.421365 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:42.421895 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:42.428338 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:42.428826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:42.429599 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:42.430034 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:42.454829 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:45:42.531214 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6d4148c6-5731-40f1-bddb-fa8d4761e849 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 204 len: 0 microversion: 2.1 time: 0.113438 May 12 15:45:42.531810 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 442/917] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:45:42 2022] DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:45:42.540459 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:42.541202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:42.547843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:42.548386 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:42.549192 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:42.549641 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:42.695120 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:42.702971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-afb38da9-f755-4f16-baf9-4b119a1cd786 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1682 microversion: 2.1 time: 0.166628 May 12 15:45:42.703539 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 476/918] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:42 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:45:43.729627 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:43.730458 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:43.739065 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:43.739517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:43.740313 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:43.740815 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:43.883420 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:43.891292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e827ae04-2603-49fa-b559-0ebbc385be1a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1682 microversion: 2.1 time: 0.168955 May 12 15:45:43.891944 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 443/919] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:43 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:44.909095 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:44.909667 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:44.916180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:44.917032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:44.917822 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:44.918261 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:45.003066 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:45.010442 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-aa57cd43-f660-4c3b-b1b0-a24909629c47 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 200 len: 1614 microversion: 2.1 time: 0.105640 May 12 15:45:45.011009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 477/920] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:44 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:45.126615 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-f5708c54-544a-4f7c-8c0b-92eff621512b req-ff348a0d-4825-425b-9437-babdab189199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e13bb6c-6990-4d32-b530-1e11c5125c6b", "name": "network-vif-deleted", "tag": "ecd06b96-36fb-4e9d-ace0-023a0cc7db72"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:45.137841 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-f5708c54-544a-4f7c-8c0b-92eff621512b req-ff348a0d-4825-425b-9437-babdab189199 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:45.138456 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-f5708c54-544a-4f7c-8c0b-92eff621512b req-ff348a0d-4825-425b-9437-babdab189199 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:45.151533 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-f5708c54-544a-4f7c-8c0b-92eff621512b req-ff348a0d-4825-425b-9437-babdab189199 service nova] Creating event network-vif-deleted:ecd06b96-36fb-4e9d-ace0-023a0cc7db72 for instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b on hv-cinder-83588 May 12 15:45:45.157989 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-f5708c54-544a-4f7c-8c0b-92eff621512b req-ff348a0d-4825-425b-9437-babdab189199 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 May 12 15:45:45.161840 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 444/921] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:46.029893 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:46.030463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:46.037144 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:46.037605 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:46.038384 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:46.038821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:46.052814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b HTTP/1.1 May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:45:46.054463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:45:46.056139 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '0e13bb6c-6990-4d32-b530-1e11c5125c6b'} May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:45:46.057449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:45:46.058899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:45:46.060954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:45:46.060954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5da5e6d5-0d53-4271-a965-d2fe9fe904b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 404 len: 111 microversion: 2.1 time: 0.029996 May 12 15:45:46.060954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 478/922] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:46 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:45:46.065430 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-fbdd3281-f344-4409-b714-8584c3daf4b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '.version_select at 0x7f60d04e6c10>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:46.085649 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-fbdd3281-f344-4409-b714-8584c3daf4b5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-77331668" status: 202 len: 0 microversion: 2.1 time: 0.024316 May 12 15:45:46.086234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 445/923] 10.222.0.89 () {58 vars in 1214 bytes} [Thu May 12 15:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-77331668 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:45:46.722589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-dd1dd1f2-26e8-4e5b-ae00-5ebe80c83afd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: .version_select at 0x7f60d607e700>, body: {"keypair": {"name": "tempest-keypair-2096740977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUEC+9tnqO8W8cV9jUlC96rRAO+noAJCbm1ePiQvl9EmvjLmKPEKkeHW3KUBVRtILLTzBBJZEqUBIQhj+VmaFOYllyT4a2sO5a5uNn1haLFIk18+4HV3/ACuB6Ypl4BGg=="}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:46.736951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-dd1dd1f2-26e8-4e5b-ae00-5ebe80c83afd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:45:46.740962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-dd1dd1f2-26e8-4e5b-ae00-5ebe80c83afd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:45:46.764599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-dd1dd1f2-26e8-4e5b-ae00-5ebe80c83afd tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045947 May 12 15:45:46.765181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 479/924] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:45:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:48.085487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1844002271", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28e8ac92-f000-41cc-98c0-a6392dfdb29f"}], "security_groups": [{"name": "tempest-securitygroup--1957733378"}], "key_name": "tempest-keypair-2096740977", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:48.195110 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] validate_networks() for [('28e8ac92-f000-41cc-98c0-a6392dfdb29f', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:45:48.567634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:45:48.568324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:45:48.569101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:45:48.569709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:45:48.570300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:45:48.583188 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:48.583783 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:48.584996 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:48.585599 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:48.606568 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:45:48.611053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:45:48.623255 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:45:48.625698 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:45:48.678514 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-676d50c8-59aa-4d57-aa4b-bfaa2f25df48 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597852 May 12 15:45:48.679167 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 446/925] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:45:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:45:48.690105 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5f922783-bac3-4bad-a775-146961161167 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:48.690835 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5f922783-bac3-4bad-a775-146961161167 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:48.743112 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5f922783-bac3-4bad-a775-146961161167 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:48.750819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5f922783-bac3-4bad-a775-146961161167 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1242 microversion: 2.1 time: 0.065144 May 12 15:45:48.751620 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 480/926] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:48 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:49.767563 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:49.768199 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:49.775516 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:49.775964 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:49.776767 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:49.777203 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:49.866051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:49.873874 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-23d9aa0f-478e-4081-8664-5b2aca91137d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1300 microversion: 2.1 time: 0.110687 May 12 15:45:49.874451 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 447/927] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:49 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:50.890382 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:50.890977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:50.897421 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:50.897867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:50.898656 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:50.899123 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:51.098288 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:51.106694 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fc7a2edd-412c-4dca-8126-6cd90659e8c3 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1368 microversion: 2.1 time: 0.220176 May 12 15:45:51.107268 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 481/928] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:50 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:51.139347 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-281510e1-9b75-4592-9f3f-2395b6cf0de0 req-e959e1da-6e39-4101-b195-ec4db40ee3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfc486-335a-4582-95e3-d5a193d6ea05", "tag": "a5eed39b-6bed-42a6-a547-d98a25ce944c"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:51.149863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-281510e1-9b75-4592-9f3f-2395b6cf0de0 req-e959e1da-6e39-4101-b195-ec4db40ee3d5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:51.150396 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-281510e1-9b75-4592-9f3f-2395b6cf0de0 req-e959e1da-6e39-4101-b195-ec4db40ee3d5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:51.163122 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-281510e1-9b75-4592-9f3f-2395b6cf0de0 req-e959e1da-6e39-4101-b195-ec4db40ee3d5 service nova] Creating event network-changed:a5eed39b-6bed-42a6-a547-d98a25ce944c for instance c0cfc486-335a-4582-95e3-d5a193d6ea05 on hv-cinder-83588 May 12 15:45:51.168379 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-281510e1-9b75-4592-9f3f-2395b6cf0de0 req-e959e1da-6e39-4101-b195-ec4db40ee3d5 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032865 May 12 15:45:51.169251 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 448/929] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:52.128449 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:52.129455 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:52.140298 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:52.141105 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:52.142372 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:52.143098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:52.272809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:52.280928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c5106a29-c3ff-4908-8b13-707df80d38f1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1368 microversion: 2.1 time: 0.158910 May 12 15:45:52.291209 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 482/930] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:52 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:53.302344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:53.303944 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:53.311181 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:53.311637 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:53.312430 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:53.312903 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:53.445961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:53.458238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-7dc74e36-a534-48cf-8386-e20548f4a1ad tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1368 microversion: 2.1 time: 0.161191 May 12 15:45:53.459094 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 449/931] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:53 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:54.484862 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:54.485850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:54.496954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:54.497695 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:54.498966 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:54.499735 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:54.649297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:54.661079 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b5ba650b-3a14-49d2-8c10-92daa83a852b tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1368 microversion: 2.1 time: 0.182522 May 12 15:45:54.662004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 483/932] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:54 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:55.684003 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:55.684569 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:55.691331 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:55.691835 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:55.692648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:55.693243 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:55.730891 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-5a4bce42-9ab6-4458-860d-a34d485dec9d req-5d769113-d50d-451f-a2c0-d7e16ab025bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cfc486-335a-4582-95e3-d5a193d6ea05", "name": "network-vif-plugged", "status": "completed", "tag": "a5eed39b-6bed-42a6-a547-d98a25ce944c"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:55.739867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-5a4bce42-9ab6-4458-860d-a34d485dec9d req-5d769113-d50d-451f-a2c0-d7e16ab025bf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:55.740321 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-5a4bce42-9ab6-4458-860d-a34d485dec9d req-5d769113-d50d-451f-a2c0-d7e16ab025bf service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:55.751728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-5a4bce42-9ab6-4458-860d-a34d485dec9d req-5d769113-d50d-451f-a2c0-d7e16ab025bf service nova] Creating event network-vif-plugged:a5eed39b-6bed-42a6-a547-d98a25ce944c for instance c0cfc486-335a-4582-95e3-d5a193d6ea05 on hv-cinder-83588 May 12 15:45:55.756977 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-5a4bce42-9ab6-4458-860d-a34d485dec9d req-5d769113-d50d-451f-a2c0-d7e16ab025bf service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029882 May 12 15:45:55.757793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 484/933] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:45:55.830434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:55.838007 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8152dfd4-7d00-4242-b663-988a31fe18cf tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1368 microversion: 2.1 time: 0.158030 May 12 15:45:55.838584 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 450/934] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:55 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:56.860850 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:56.861899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:56.868960 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:56.869411 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:56.870183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:56.870619 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:57.000868 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:57.010540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ac6a0cd7-6593-4657-bad9-f90b54c27f5e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1368 microversion: 2.1 time: 0.157856 May 12 15:45:57.011096 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 485/935] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:56 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:58.031889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:58.032694 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:58.040155 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:58.040637 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:58.041729 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:58.042199 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:58.473332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:45:58.484908 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-182f676e-6585-479b-b341-972026fcf902 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1558 microversion: 2.1 time: 0.457464 May 12 15:45:58.485701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 451/936] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:45:58 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1558 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:45:58.504922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:45:58.505469 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:45:58.515326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:58.515971 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:58.517222 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:58.518007 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:58.600519 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-401369f4-11dd-457d-9568-fd6c5d1cf928 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101081 May 12 15:45:58.601368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 486/937] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:45:58 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:45:59.622355 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-a0be146c-d747-4c0d-be99-a5141aec8cd5 req-62bdfadc-568c-43d4-9edb-73684ccd8d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0cfc486-335a-4582-95e3-d5a193d6ea05", "tag": "a5eed39b-6bed-42a6-a547-d98a25ce944c"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:45:59.631120 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-a0be146c-d747-4c0d-be99-a5141aec8cd5 req-62bdfadc-568c-43d4-9edb-73684ccd8d9e service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:45:59.631556 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-a0be146c-d747-4c0d-be99-a5141aec8cd5 req-62bdfadc-568c-43d4-9edb-73684ccd8d9e service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:45:59.644503 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-a0be146c-d747-4c0d-be99-a5141aec8cd5 req-62bdfadc-568c-43d4-9edb-73684ccd8d9e service nova] Creating event network-changed:a5eed39b-6bed-42a6-a547-d98a25ce944c for instance c0cfc486-335a-4582-95e3-d5a193d6ea05 on hv-cinder-83588 May 12 15:45:59.649488 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-a0be146c-d747-4c0d-be99-a5141aec8cd5 req-62bdfadc-568c-43d4-9edb-73684ccd8d9e service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030884 May 12 15:45:59.650044 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 452/938] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:46:26.814315 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:26.814880 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:26.816325 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-3c114339-969f-4612-8b52-ddf33e3b0413 req-af24d13b-3a53-434f-80ae-88919f511ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63d43ec-7046-4884-b2b8-c3ece839bd3c", "tag": "aae4bb46-71ca-4a34-b515-03e88e478136"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:26.821567 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:26.822034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:26.822821 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:26.823233 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:26.824652 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-3c114339-969f-4612-8b52-ddf33e3b0413 req-af24d13b-3a53-434f-80ae-88919f511ed8 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:26.825101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-3c114339-969f-4612-8b52-ddf33e3b0413 req-af24d13b-3a53-434f-80ae-88919f511ed8 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:26.836282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-3c114339-969f-4612-8b52-ddf33e3b0413 req-af24d13b-3a53-434f-80ae-88919f511ed8 service nova] Creating event network-changed:aae4bb46-71ca-4a34-b515-03e88e478136 for instance e63d43ec-7046-4884-b2b8-c3ece839bd3c on hv-cinder-83588 May 12 15:46:26.842108 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-3c114339-969f-4612-8b52-ddf33e3b0413 req-af24d13b-3a53-434f-80ae-88919f511ed8 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030175 May 12 15:46:26.845167 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 453/939] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:46:26.857786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:46:26.942963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-78cc0788-de62-4348-ab5d-2c7d6c1e68bf tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "DELETE /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 204 len: 0 microversion: 2.1 time: 0.133125 May 12 15:46:26.943942 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 487/940] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:46:26 2022] DELETE /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:46:26.953300 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:26.953998 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:26.960633 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:26.961258 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:26.962055 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:26.962493 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:27.111100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:27.119102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-78f8bc22-72f4-41d4-ab2d-5077b8c2509a tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1577 microversion: 2.1 time: 0.170642 May 12 15:46:27.119900 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 454/941] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:26 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:28.137707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:28.138401 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:28.144912 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:28.145402 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:28.146176 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:28.146614 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:28.315728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:28.324805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-645a1888-f647-4744-ace1-cf89fbda3a11 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1577 microversion: 2.1 time: 0.191318 May 12 15:46:28.325630 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 488/942] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:28 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:29.084187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-614769d8-107e-40f5-ad8f-7d57f490536f req-6ac8fc0e-3288-42ae-a380-ff8a3db8ddbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63d43ec-7046-4884-b2b8-c3ece839bd3c", "name": "network-vif-deleted", "tag": "aae4bb46-71ca-4a34-b515-03e88e478136"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:29.093891 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-614769d8-107e-40f5-ad8f-7d57f490536f req-6ac8fc0e-3288-42ae-a380-ff8a3db8ddbb service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:29.094328 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-614769d8-107e-40f5-ad8f-7d57f490536f req-6ac8fc0e-3288-42ae-a380-ff8a3db8ddbb service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:29.105862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-614769d8-107e-40f5-ad8f-7d57f490536f req-6ac8fc0e-3288-42ae-a380-ff8a3db8ddbb service nova] Creating event network-vif-deleted:aae4bb46-71ca-4a34-b515-03e88e478136 for instance e63d43ec-7046-4884-b2b8-c3ece839bd3c on hv-cinder-83588 May 12 15:46:29.111189 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-614769d8-107e-40f5-ad8f-7d57f490536f req-6ac8fc0e-3288-42ae-a380-ff8a3db8ddbb service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 May 12 15:46:29.111777 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 455/943] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:29.343021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:29.343642 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:29.352263 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:29.352758 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:29.353572 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:29.353995 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:29.424728 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:29.433289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-fc573e8f-02a5-448f-bb5d-1b378bd3d477 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 200 len: 1225 microversion: 2.1 time: 0.094662 May 12 15:46:29.438907 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 489/944] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:29 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:29.932071 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:29.932938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:29.943668 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:29.944410 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:29.945792 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:29.946224 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:29.968971 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-4b3ee8f4-017a-4e69-9bc1-4fa3bb0dc518 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/ips" status: 200 len: 150 microversion: 2.1 time: 0.044219 May 12 15:46:29.969527 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 456/945] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:46:29 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:30.456503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:30.457368 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: e63d43ec-7046-4884-b2b8-c3ece839bd3c] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:30.468163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:30.468983 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:30.470294 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:30.471024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:30.488608 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] HTTP exception thrown: Instance e63d43ec-7046-4884-b2b8-c3ece839bd3c could not be found. May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Request method failure captured: May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c HTTP/1.1 May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSoA1BMIUe1sKJzh0YAPq-L7dKCO8koWPT6H70HXJergK8Cj1bByKUJUe9P8Jzg57auB-HnJdtF9Efhq5d3Tu2eXR6AUGvMaISPeNjwNvZjpe9wQ94mAA5lRKW5xg-8IkMjyPY2LWRIMiYMws1RzTy1UP3Ob3wH2IBo0ycktzZl8N9Q May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:46:30.490252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_4b8824725a894bbcb17789008292c1e4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-TestVolumeBootPattern-972638363 May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 73bfb098d5f04da9adb7ae1d30fd30b1 May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance e63d43ec-7046-4884-b2b8-c3ece839bd3c could not be found. May 12 15:46:30.492928 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'e63d43ec-7046-4884-b2b8-c3ece839bd3c'} May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63d43ec-7046-4884-b2b8-c3ece839bd3c could not be found. May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:46:30.494289 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63d43ec-7046-4884-b2b8-c3ece839bd3c could not be found. May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63d43ec-7046-4884-b2b8-c3ece839bd3c could not be found. May 12 15:46:30.496691 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:30.499048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Returning 404 to user: Instance e63d43ec-7046-4884-b2b8-c3ece839bd3c could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:46:30.499048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e869cbf1-187b-4526-9b7a-03bf758e47bc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c" status: 404 len: 111 microversion: 2.1 time: 0.042006 May 12 15:46:30.499048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 490/946] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:30 2022] GET /compute/v2.1/servers/e63d43ec-7046-4884-b2b8-c3ece839bd3c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:46:31.301438 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7889055-702f-4872-83e0-3505bb8ca007"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:31.302535 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:31.308648 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:31.309101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:31.309865 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:31.310296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:31.567906 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0acbd128-d47f-4f36-8717-8bb3444fa585 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270980 May 12 15:46:31.568789 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 457/947] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:46:31 2022] POST /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:33.620950 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:33.621470 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:33.628347 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:33.628857 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:33.629672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:33.629892 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-9074b62f-d1c1-43ce-b511-7c1c48b9333a req-3869365b-55d4-416c-bf95-e756c0e4c6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c50e59-f764-41d6-bd06-1a2ac7bc5d61", "tag": "ca51c60f-918e-4a96-8760-a4f1a7d0c522"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:33.630318 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:33.638962 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-9074b62f-d1c1-43ce-b511-7c1c48b9333a req-3869365b-55d4-416c-bf95-e756c0e4c6e5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:33.639802 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-9074b62f-d1c1-43ce-b511-7c1c48b9333a req-3869365b-55d4-416c-bf95-e756c0e4c6e5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:33.650321 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-9074b62f-d1c1-43ce-b511-7c1c48b9333a req-3869365b-55d4-416c-bf95-e756c0e4c6e5 service nova] Creating event network-changed:ca51c60f-918e-4a96-8760-a4f1a7d0c522 for instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 on hv-cinder-83588 May 12 15:46:33.655368 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-9074b62f-d1c1-43ce-b511-7c1c48b9333a req-3869365b-55d4-416c-bf95-e756c0e4c6e5 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029329 May 12 15:46:33.657427 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:46:33.659588 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 458/948] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:33.752282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-50b0e5a7-21a6-4846-8a4f-ffa36d2133c0 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "DELETE /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 204 len: 0 microversion: 2.1 time: 0.135065 May 12 15:46:33.752926 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 491/949] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:46:33 2022] DELETE /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:46:33.762960 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:33.763645 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:33.771976 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:33.772431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:33.773257 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:33.773931 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:33.931459 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:33.939218 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d91399c5-0b80-453d-ba27-dd99df710eff tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1578 microversion: 2.1 time: 0.181210 May 12 15:46:33.939868 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 459/950] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:33 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:34.957794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:34.958355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:34.965084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:34.965814 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:34.966600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:34.967036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:35.164097 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:35.173200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-7650f0b2-c39a-416d-8b44-a23f62db2b4d tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1578 microversion: 2.1 time: 0.219765 May 12 15:46:35.173786 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 492/951] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:34 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:35.693653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-5ce27d32-c31c-40ba-b854-8ec6e0a46c3a req-a2270eb0-ad1f-4713-998d-90acb63f1eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c50e59-f764-41d6-bd06-1a2ac7bc5d61", "name": "network-vif-deleted", "tag": "ca51c60f-918e-4a96-8760-a4f1a7d0c522"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:35.703254 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-5ce27d32-c31c-40ba-b854-8ec6e0a46c3a req-a2270eb0-ad1f-4713-998d-90acb63f1eae service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:35.703701 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-5ce27d32-c31c-40ba-b854-8ec6e0a46c3a req-a2270eb0-ad1f-4713-998d-90acb63f1eae service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:35.715091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-5ce27d32-c31c-40ba-b854-8ec6e0a46c3a req-a2270eb0-ad1f-4713-998d-90acb63f1eae service nova] Creating event network-vif-deleted:ca51c60f-918e-4a96-8760-a4f1a7d0c522 for instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 on hv-cinder-83588 May 12 15:46:35.720345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-5ce27d32-c31c-40ba-b854-8ec6e0a46c3a req-a2270eb0-ad1f-4713-998d-90acb63f1eae service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 May 12 15:46:35.720970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 460/952] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:36.196363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:36.197395 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:36.209374 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:36.210125 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:36.211897 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:36.212904 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:36.246935 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:36.247419 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:36.247894 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lazy-loading 'fault' on Instance uuid a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:46:36.293391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bfb098d5f04da9adb7ae1d30fd30b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b8824725a894bbcb17789008292c1e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:36.301107 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3feabef8-54fd-4ac3-a036-4e31b5809350 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 200 len: 1230 microversion: 2.1 time: 0.111331 May 12 15:46:36.301681 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 493/953] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:36 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:37.319961 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:37.320642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: a4c50e59-f764-41d6-bd06-1a2ac7bc5d61] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:37.327842 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:37.328292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:37.329115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:37.329554 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:37.344839 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] HTTP exception thrown: Instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 could not be found. May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Request method failure captured: May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 HTTP/1.1 May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSoA1BMIUe1sKJzh0YAPq-L7dKCO8koWPT6H70HXJergK8Cj1bByKUJUe9P8Jzg57auB-HnJdtF9Efhq5d3Tu2eXR6AUGvMaISPeNjwNvZjpe9wQ94mAA5lRKW5xg-8IkMjyPY2LWRIMiYMws1RzTy1UP3Ob3wH2IBo0ycktzZl8N9Q May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:46:37.346455 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_4b8824725a894bbcb17789008292c1e4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: 73bfb098d5f04da9adb7ae1d30fd30b1 May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 could not be found. May 12 15:46:37.348232 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'a4c50e59-f764-41d6-bd06-1a2ac7bc5d61'} May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 could not be found. May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:46:37.349264 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 could not be found. May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 could not be found. May 12 15:46:37.350889 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.352452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Returning 404 to user: Instance a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:46:37.352452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cb35e861-0292-419c-a22d-9d0f803b474c tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61" status: 404 len: 111 microversion: 2.1 time: 0.032719 May 12 15:46:37.352452 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 461/954] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:37 2022] GET /compute/v2.1/servers/a4c50e59-f764-41d6-bd06-1a2ac7bc5d61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:46:37.807751 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:37.808485 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:37.815551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:37.816002 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:37.816805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:37.817241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:37.830784 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] HTTP exception thrown: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Request method failure captured: May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 HTTP/1.1 May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSoA1BMIUe1sKJzh0YAPq-L7dKCO8koWPT6H70HXJergK8Cj1bByKUJUe9P8Jzg57auB-HnJdtF9Efhq5d3Tu2eXR6AUGvMaISPeNjwNvZjpe9wQ94mAA5lRKW5xg-8IkMjyPY2LWRIMiYMws1RzTy1UP3Ob3wH2IBo0ycktzZl8N9Q May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:46:37.832452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_4b8824725a894bbcb17789008292c1e4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 73bfb098d5f04da9adb7ae1d30fd30b1 May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.834009 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '7dc5f8be-b344-46fd-bae9-266847ebfdc1'} May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:46:37.834819 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.836310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:37.837870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Returning 404 to user: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:46:37.837870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3ab30cca-942c-49dd-8acd-eb59c564ac02 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "DELETE /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 404 len: 111 microversion: 2.1 time: 0.032580 May 12 15:46:37.837870 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 494/955] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:46:37 2022] DELETE /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:46:37.842647 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:37.843468 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] [instance: 7dc5f8be-b344-46fd-bae9-266847ebfdc1] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:37.849902 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:37.850353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:37.851118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:37.851549 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:37.865376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] HTTP exception thrown: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Request method failure captured: May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 HTTP/1.1 May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSoA1BMIUe1sKJzh0YAPq-L7dKCO8koWPT6H70HXJergK8Cj1bByKUJUe9P8Jzg57auB-HnJdtF9Efhq5d3Tu2eXR6AUGvMaISPeNjwNvZjpe9wQ94mAA5lRKW5xg-8IkMjyPY2LWRIMiYMws1RzTy1UP3Ob3wH2IBo0ycktzZl8N9Q May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:46:37.867006 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_4b8824725a894bbcb17789008292c1e4", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/4b8824725a894bbcb17789008292c1e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 4b8824725a894bbcb17789008292c1e4 May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-TestVolumeBootPattern-972638363 May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: 73bfb098d5f04da9adb7ae1d30fd30b1 May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-TestVolumeBootPattern-972638363-project May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.868896 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '7dc5f8be-b344-46fd-bae9-266847ebfdc1'} May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:46:37.869804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. May 12 15:46:37.871072 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:46:37.872345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Returning 404 to user: Instance 7dc5f8be-b344-46fd-bae9-266847ebfdc1 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:46:37.872345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-012c237e-221c-4c6f-ab2d-7f74cd762328 tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1" status: 404 len: 111 microversion: 2.1 time: 0.029672 May 12 15:46:37.872345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 462/956] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:37 2022] GET /compute/v2.1/servers/7dc5f8be-b344-46fd-bae9-266847ebfdc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:46:38.039811 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7889055-702f-4872-83e0-3505bb8ca007"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:38.041022 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:38.047633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:38.048084 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:38.048899 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:38.049327 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:38.129402 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Invalid volume: volume e7889055-702f-4872-83e0-3505bb8ca007 is already attached to instances: c0cfc486-335a-4582-95e3-d5a193d6ea05 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: POST /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments HTTP/1.1 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 74 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:46:38.131021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {"volumeAttachment": {"volumeId": "e7889055-702f-4872-83e0-3505bb8ca007"}} May 12 15:46:38.132770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Invalid volume: volume e7889055-702f-4872-83e0-3505bb8ca007 is already attached to instances: c0cfc486-335a-4582-95e3-d5a193d6ea05 May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'server_id': 'c0cfc486-335a-4582-95e3-d5a193d6ea05', 'body': {'volumeAttachment': {'volumeId': 'e7889055-702f-4872-83e0-3505bb8ca007'}}} May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7889055-702f-4872-83e0-3505bb8ca007 is already attached to instances: c0cfc486-335a-4582-95e3-d5a193d6ea05 May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:38.133753 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7889055-702f-4872-83e0-3505bb8ca007 is already attached to instances: c0cfc486-335a-4582-95e3-d5a193d6ea05 May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:38.135252 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7889055-702f-4872-83e0-3505bb8ca007 is already attached to instances: c0cfc486-335a-4582-95e3-d5a193d6ea05 May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 400 to user: Invalid volume: volume e7889055-702f-4872-83e0-3505bb8ca007 is already attached to instances: c0cfc486-335a-4582-95e3-d5a193d6ea05 {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-c691c444-d8bc-4466-a7f3-0d18c064d65e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096655 May 12 15:46:38.136963 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 495/957] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:46:38 2022] POST /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 15:46:38.192341 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:38.192812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:38.199123 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:38.199577 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:38.200357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:38.200839 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:38.286195 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lazy-loading 'services' on Instance uuid c0cfc486-335a-4582-95e3-d5a193d6ea05 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:46:38.362785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9e790439-ccf3-41dd-b496-df2960e6ecb7 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments/e7889055-702f-4872-83e0-3505bb8ca007" status: 202 len: 0 microversion: 2.1 time: 0.174409 May 12 15:46:38.363397 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 463/958] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:46:38 2022] DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments/e7889055-702f-4872-83e0-3505bb8ca007 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:46:38.371985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:38.373156 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:38.379561 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:38.380064 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:38.380860 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:38.381322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:38.413658 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-127f5de6-a116-48b0-b0f0-77a18a51b3c6 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 May 12 15:46:38.414216 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 496/959] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:46:38 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:39.190691 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-eb1d6907-eb0e-4aff-b799-d5e9c3a2badc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] Calling method '.version_select at 0x7f60d04e68b0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:39.210246 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-eb1d6907-eb0e-4aff-b799-d5e9c3a2badc tempest-TestVolumeBootPattern-972638363 tempest-TestVolumeBootPattern-972638363-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546602223" status: 202 len: 0 microversion: 2.1 time: 0.023739 May 12 15:46:39.210873 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 464/960] 10.222.0.89 () {58 vars in 1262 bytes} [Thu May 12 15:46:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546602223 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:46:39.426029 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:39.426989 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:39.433680 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:39.434124 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:39.434887 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:39.435315 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:39.464442 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6d375d1c-f935-4942-9e7f-630ffb2f7d22 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042401 May 12 15:46:39.465020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 497/961] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:46:39 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:46:39.523132 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:39.523939 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:39.531312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:39.531777 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:39.532558 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:39.532983 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:39.559156 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:46:39.637037 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-370386bc-f5ed-49f7-80f9-f8c00edfdc2e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 204 len: 0 microversion: 2.1 time: 0.117794 May 12 15:46:39.637751 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 465/962] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:46:39 2022] DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:46:39.646955 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:39.647562 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:39.653815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:39.654274 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:39.655052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:39.655494 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:39.784203 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:39.792290 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-29c7510d-df78-457c-acfe-92de5c5976af tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1683 microversion: 2.1 time: 0.149464 May 12 15:46:39.792838 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 498/963] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:39 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:40.811446 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:40.812049 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:40.818949 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:40.819403 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:40.820182 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:40.820654 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:40.954498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:40.962344 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-8f716eed-99a7-4099-b322-4c5decdb3747 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1683 microversion: 2.1 time: 0.155781 May 12 15:46:40.963288 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 466/964] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:40 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:41.979483 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:41.980205 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:41.989996 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:41.990717 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:41.991911 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:41.992456 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:42.080010 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-9a771cb9-b368-4641-96b3-da26c7b9aa8b req-b32cedbe-529d-4ae9-8f81-17429746e5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0cfc486-335a-4582-95e3-d5a193d6ea05", "name": "network-vif-deleted", "tag": "a5eed39b-6bed-42a6-a547-d98a25ce944c"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:42.109944 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:42.117708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-9a771cb9-b368-4641-96b3-da26c7b9aa8b req-b32cedbe-529d-4ae9-8f81-17429746e5f1 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:42.118089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-9a771cb9-b368-4641-96b3-da26c7b9aa8b req-b32cedbe-529d-4ae9-8f81-17429746e5f1 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:42.119350 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b5eb6965-1409-411d-ac6d-3b02dcb013a5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 200 len: 1615 microversion: 2.1 time: 0.143814 May 12 15:46:42.129659 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 499/965] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:41 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 1615 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:42.152030 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-9a771cb9-b368-4641-96b3-da26c7b9aa8b req-b32cedbe-529d-4ae9-8f81-17429746e5f1 service nova] Creating event network-vif-deleted:a5eed39b-6bed-42a6-a547-d98a25ce944c for instance c0cfc486-335a-4582-95e3-d5a193d6ea05 on hv-cinder-83588 May 12 15:46:42.164056 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-9a771cb9-b368-4641-96b3-da26c7b9aa8b req-b32cedbe-529d-4ae9-8f81-17429746e5f1 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088010 May 12 15:46:42.164728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 467/966] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:46:43.137071 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:43.137766 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:43.144846 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:43.145391 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:43.146242 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:43.146754 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:43.161611 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 HTTP/1.1 May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:46:43.163237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:46:43.165016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'c0cfc486-335a-4582-95e3-d5a193d6ea05'} May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:46:43.165939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:46:43.167767 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:46:43.170353 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:46:43.171270 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e7a8fb62-7b36-409e-bfbb-f14eedd2c959 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 404 len: 111 microversion: 2.1 time: 0.038233 May 12 15:46:43.171917 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 500/967] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:43 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:46:43.180957 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-556c119f-87ed-4267-a7f5-fae523b8c357 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '.version_select at 0x7f60d0643ee0>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:43.202780 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-556c119f-87ed-4267-a7f5-fae523b8c357 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096740977" status: 202 len: 0 microversion: 2.1 time: 0.025908 May 12 15:46:43.204149 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 468/968] 10.222.0.89 () {58 vars in 1220 bytes} [Thu May 12 15:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096740977 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:46:43.877902 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0ea7e9ab-b3a2-4513-b241-e7e55279d55d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: .version_select at 0x7f60d607e160>, body: {"keypair": {"name": "tempest-keypair-2021557418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwyZmknRUu+1XozW2TyUePVzt+FKI2/VQjRXBv6px5kZ4+RJvcIRR39nDUC6jNnCOFhE78Qtr2G78SVdzJcx4KYartLKpoXodkoKcRwBQjJmHgn8MSm83hsjmxiBHecRA=="}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:43.893380 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-0ea7e9ab-b3a2-4513-b241-e7e55279d55d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:46:43.897400 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-0ea7e9ab-b3a2-4513-b241-e7e55279d55d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'key_pairs'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:46:43.920092 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0ea7e9ab-b3a2-4513-b241-e7e55279d55d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046127 May 12 15:46:43.920725 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 501/969] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:46:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:46.085881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1165049225", "imageRef": "0a2b5871-ecc5-467f-8342-f0331879eea4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28e8ac92-f000-41cc-98c0-a6392dfdb29f"}], "security_groups": [{"name": "tempest-securitygroup--890247807"}], "key_name": "tempest-keypair-2021557418", "user_data": "}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:46.224870 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.network.neutron [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] validate_networks() for [('28e8ac92-f000-41cc-98c0-a6392dfdb29f', None, None, None, None, None)] {{(pid=123633) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:46:46.658296 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:46:46.658832 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image limits 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:46:46.659757 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Flavor pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:46:46.660267 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Image pref 0:0:0 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:46:46.661269 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.virt.hardware [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:46:46.672165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:46.672886 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:46.673887 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:46.674782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:46.693781 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:46:46.698247 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Getting quotas for user ce1b4eadec3e4c4dae998f154b5966d7 and project 7c7462c1e31649e9849721910b3262a3. Resources: {'instances', 'cores', 'ram'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:46:46.711467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Going to run 1 instances... {{(pid=123633) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:46:46.714035 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a2b5871-ecc5-467f-8342-f0331879eea4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:46:46.766984 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-15bce57c-c564-4fe6-80f3-60ae3df5f1f5 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.686336 May 12 15:46:46.767807 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 469/970] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:46:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:46:46.778463 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-987d6992-9101-414e-a524-658dbf809489 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:46.779287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-987d6992-9101-414e-a524-658dbf809489 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:46.866141 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-987d6992-9101-414e-a524-658dbf809489 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:46.873748 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-987d6992-9101-414e-a524-658dbf809489 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1242 microversion: 2.1 time: 0.099881 May 12 15:46:46.874310 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 502/971] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:46 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:47.891187 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:47.891795 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:47.899287 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:47.899750 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:47.900575 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:47.901020 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:48.013766 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:48.024285 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0dbf8dfb-2f9a-40ea-aea2-5967ac02d127 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1300 microversion: 2.1 time: 0.137762 May 12 15:46:48.025603 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 470/972] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:47 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:46:49.042815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:49.043556 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:49.050322 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:49.050776 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:49.051560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:49.051998 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:49.241669 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-2f4a33e9-48b6-4a72-9e11-11f27eb1c6c4 req-eb45a756-aaf7-413f-b5f1-718e7b363d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f8cf00-9637-4105-83e7-2ba41eda67a4", "tag": "0910bcd9-b358-40b5-aeb2-c2a5b7b931b6"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:49.252286 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-2f4a33e9-48b6-4a72-9e11-11f27eb1c6c4 req-eb45a756-aaf7-413f-b5f1-718e7b363d1b service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:49.253218 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-2f4a33e9-48b6-4a72-9e11-11f27eb1c6c4 req-eb45a756-aaf7-413f-b5f1-718e7b363d1b service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:49.265522 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-2f4a33e9-48b6-4a72-9e11-11f27eb1c6c4 req-eb45a756-aaf7-413f-b5f1-718e7b363d1b service nova] Creating event network-changed:0910bcd9-b358-40b5-aeb2-c2a5b7b931b6 for instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 on hv-cinder-83588 May 12 15:46:49.268362 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:49.271150 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-2f4a33e9-48b6-4a72-9e11-11f27eb1c6c4 req-eb45a756-aaf7-413f-b5f1-718e7b363d1b service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 May 12 15:46:49.272640 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 471/973] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:49.278567 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-b7163b5f-988e-4493-b92f-fa58d3be2a21 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.240332 May 12 15:46:49.279153 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 503/974] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:49 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:50.301938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:50.303047 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:50.312498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:50.312973 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:50.313800 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:50.314238 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:50.512012 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:50.519778 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b61367fc-b362-4906-88aa-bd4154067a5c tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.225747 May 12 15:46:50.520392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 472/975] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:50 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:51.540761 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:51.542163 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:51.550013 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:51.550469 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:51.551250 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:51.551692 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:51.691212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:51.703086 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-bba9b525-f227-44a5-854a-054e1a7c55fc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.168553 May 12 15:46:51.703708 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 504/976] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:51 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:52.728163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:52.729233 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:52.740293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:52.741119 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:52.742387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:52.743116 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:52.880677 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:52.888156 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-bf2d4307-6d66-4c49-a176-518b2941dc86 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.166441 May 12 15:46:52.888744 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 473/977] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:52 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:53.907032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:53.907682 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:53.917465 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:53.918052 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:53.918949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:53.919589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:54.051994 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:54.059793 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-638463c4-609d-4b19-a112-6fd6890b0ec0 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.158411 May 12 15:46:54.060407 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 505/978] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:53 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:55.079354 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:55.079994 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:55.087721 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:55.088324 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:55.089127 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:55.089558 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:55.445039 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:55.452679 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1a8ee5b7-9aa7-446b-88ef-c3d4467b7642 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.378759 May 12 15:46:55.453263 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 474/979] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:55 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:55.920278 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-cfa7581b-d708-4a39-b1ce-00b5a9d74bc6 req-654dc41d-bd0b-4678-bffe-f3e455d5d9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f8cf00-9637-4105-83e7-2ba41eda67a4", "name": "network-vif-plugged", "status": "completed", "tag": "0910bcd9-b358-40b5-aeb2-c2a5b7b931b6"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:55.929243 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-cfa7581b-d708-4a39-b1ce-00b5a9d74bc6 req-654dc41d-bd0b-4678-bffe-f3e455d5d9f5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:55.929845 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-cfa7581b-d708-4a39-b1ce-00b5a9d74bc6 req-654dc41d-bd0b-4678-bffe-f3e455d5d9f5 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:55.941837 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-cfa7581b-d708-4a39-b1ce-00b5a9d74bc6 req-654dc41d-bd0b-4678-bffe-f3e455d5d9f5 service nova] Creating event network-vif-plugged:0910bcd9-b358-40b5-aeb2-c2a5b7b931b6 for instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 on hv-cinder-83588 May 12 15:46:55.947076 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-cfa7581b-d708-4a39-b1ce-00b5a9d74bc6 req-654dc41d-bd0b-4678-bffe-f3e455d5d9f5 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 May 12 15:46:55.947664 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 506/980] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:56.470836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:56.471424 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:56.479440 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:56.480056 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:56.481074 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:56.481511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:56.622101 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:56.633716 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1b8274f0-7640-45a2-bacc-6c97d9797616 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1367 microversion: 2.1 time: 0.166847 May 12 15:46:56.634417 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 475/981] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:56 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:57.652720 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:57.653522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:57.660342 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:57.660810 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:57.661577 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:57.662004 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:58.140714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:46:58.148805 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-34a34173-bcd0-4234-b02e-388f74871383 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1558 microversion: 2.1 time: 0.500815 May 12 15:46:58.149376 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 507/982] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:46:57 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1558 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:46:58.165394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:46:58.165949 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:46:58.173189 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:58.173643 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:58.174425 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:58.174890 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:58.265292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-13d8340c-a9a1-4356-b612-b610c8934888 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103790 May 12 15:46:58.265927 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 476/983] 10.222.0.89 () {58 vars in 1274 bytes} [Thu May 12 15:46:58 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:46:59.293964 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-6b33d5ce-8b4e-4b72-971c-9de3d84c1987 req-7e48602d-bca8-4e32-b2b0-b937d2cd7ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f8cf00-9637-4105-83e7-2ba41eda67a4", "tag": "0910bcd9-b358-40b5-aeb2-c2a5b7b931b6"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:46:59.303212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-6b33d5ce-8b4e-4b72-971c-9de3d84c1987 req-7e48602d-bca8-4e32-b2b0-b937d2cd7ac1 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:46:59.303664 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-6b33d5ce-8b4e-4b72-971c-9de3d84c1987 req-7e48602d-bca8-4e32-b2b0-b937d2cd7ac1 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:46:59.316038 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-6b33d5ce-8b4e-4b72-971c-9de3d84c1987 req-7e48602d-bca8-4e32-b2b0-b937d2cd7ac1 service nova] Creating event network-changed:0910bcd9-b358-40b5-aeb2-c2a5b7b931b6 for instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 on hv-cinder-83588 May 12 15:46:59.322553 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-6b33d5ce-8b4e-4b72-971c-9de3d84c1987 req-7e48602d-bca8-4e32-b2b0-b937d2cd7ac1 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032262 May 12 15:46:59.323672 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 508/984] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:47:00.612714 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:47:00.613813 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:47:33.290421 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:33.291404 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:33.302209 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:33.302967 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:33.303950 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:33.304391 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:33.328814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-6e5caf07-fcd4-4cc1-bc13-dd2fb87cd362 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/ips" status: 200 len: 151 microversion: 2.1 time: 0.046409 May 12 15:47:33.329374 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 477/985] 10.222.0.89 () {58 vars in 1247 bytes} [Thu May 12 15:47:33 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:47:34.661375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39284e53-78ec-4e71-9fc8-86e5caf0d347"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:47:34.662530 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:34.669853 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:34.670303 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:34.671069 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:34.671506 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:34.925109 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-208b6f73-b82b-49fd-a078-99888d7fde6f tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "POST /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268682 May 12 15:47:34.925704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 509/986] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:47:34 2022] POST /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:47:41.531654 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:41.532175 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:41.539036 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:41.539487 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:41.540260 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:41.540709 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:41.627317 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lazy-loading 'services' on Instance uuid 62f8cf00-9637-4105-83e7-2ba41eda67a4 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:47:41.698804 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-e0936f61-e9a9-4623-8e0a-c71251bc6a3d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments/39284e53-78ec-4e71-9fc8-86e5caf0d347" status: 202 len: 0 microversion: 2.1 time: 0.170879 May 12 15:47:41.699413 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 478/987] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:47:41 2022] DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments/39284e53-78ec-4e71-9fc8-86e5caf0d347 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:47:41.708885 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:41.710103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:41.718336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:41.718788 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:41.719750 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:41.720365 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:41.750470 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1ce3d1f2-c66c-445e-8327-cb7192173c9d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 May 12 15:47:41.750999 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 510/988] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:47:41 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:47:42.768762 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:42.770401 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:42.781244 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:42.781994 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:42.783266 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:42.783993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:42.817167 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-c8605182-bbd8-47d4-82da-c64a6a952eab tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056566 May 12 15:47:42.817663 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 479/989] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:47:42 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:47:42.879211 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:42.879754 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:42.889600 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:42.890152 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:42.891309 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:42.891933 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:42.919566 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Going to try to terminate instance {{(pid=123632) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:47:43.003526 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-72280f94-49e0-4c28-8bca-6172c318aa45 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 204 len: 0 microversion: 2.1 time: 0.129773 May 12 15:47:43.004319 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 511/990] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:47:42 2022] DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:47:43.013850 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:43.014460 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:43.021165 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:43.021619 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:43.022394 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:43.022834 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:43.159635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:47:43.171186 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b1759afa-aca4-455e-9d4a-04e5af1e5cda tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1683 microversion: 2.1 time: 0.161258 May 12 15:47:43.171936 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 480/991] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:43 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:47:44.193531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:44.194685 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:44.202792 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:44.203181 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:44.203992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:44.204433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:44.342983 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:47:44.350578 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ec04b595-2b05-42a0-95d6-cca0129b242a tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1683 microversion: 2.1 time: 0.164204 May 12 15:47:44.351157 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 512/992] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:44 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:47:45.367909 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:45.368552 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:45.376566 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:45.377229 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:45.378290 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:45.378743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:45.458448 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce1b4eadec3e4c4dae998f154b5966d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7462c1e31649e9849721910b3262a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:47:45.466173 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-812b5974-c8d9-4761-bcbc-7661157faff4 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 200 len: 1616 microversion: 2.1 time: 0.102131 May 12 15:47:45.466751 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 481/993] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:45 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 1616 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:47:45.554348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-1601b355-5269-4d9f-90c4-b85628bea61f req-1a76c5cb-a9a9-421d-953d-7087fa64f060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f8cf00-9637-4105-83e7-2ba41eda67a4", "name": "network-vif-deleted", "tag": "0910bcd9-b358-40b5-aeb2-c2a5b7b931b6"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:47:45.567478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1601b355-5269-4d9f-90c4-b85628bea61f req-1a76c5cb-a9a9-421d-953d-7087fa64f060 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:45.568538 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1601b355-5269-4d9f-90c4-b85628bea61f req-1a76c5cb-a9a9-421d-953d-7087fa64f060 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:45.593970 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-1601b355-5269-4d9f-90c4-b85628bea61f req-1a76c5cb-a9a9-421d-953d-7087fa64f060 service nova] Creating event network-vif-deleted:0910bcd9-b358-40b5-aeb2-c2a5b7b931b6 for instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 on hv-cinder-83588 May 12 15:47:45.600316 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-1601b355-5269-4d9f-90c4-b85628bea61f req-1a76c5cb-a9a9-421d-953d-7087fa64f060 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144849 May 12 15:47:45.601247 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 513/994] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:47:46.483582 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:46.484293 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:46.491215 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:46.491672 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:46.492444 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:46.492914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:46.507049 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 HTTP/1.1 May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:47:46.508812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:46.510589 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '62f8cf00-9637-4105-83e7-2ba41eda67a4'} May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:46.511393 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:46.512774 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:46.513997 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:46.513997 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2d89a741-c409-43b6-beca-365b16ba4f5d tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 404 len: 111 microversion: 2.1 time: 0.030612 May 12 15:47:46.514861 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 482/995] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:46 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:47:46.520238 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1d08657a-bf17-4364-ae84-5ed73332c48e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '.version_select at 0x7f60d0d18310>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:46.542032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1d08657a-bf17-4364-ae84-5ed73332c48e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021557418" status: 202 len: 0 microversion: 2.1 time: 0.025446 May 12 15:47:46.542742 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 514/996] 10.222.0.89 () {58 vars in 1220 bytes} [Thu May 12 15:47:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021557418 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:47:48.320108 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:48.321234 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:48.327688 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:48.328138 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:48.328952 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:48.329385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:48.342807 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 HTTP/1.1 May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:47:48.344353 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.345935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '62f8cf00-9637-4105-83e7-2ba41eda67a4'} May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:48.347081 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.348592 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:48.350273 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:48.350273 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ad03fc83-f419-4a5d-94ee-a20bf902c201 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 404 len: 111 microversion: 2.1 time: 0.029502 May 12 15:47:48.350273 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 483/997] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:47:48 2022] DELETE /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:47:48.355825 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:48.356770 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 62f8cf00-9637-4105-83e7-2ba41eda67a4] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:48.367629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:48.368241 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:48.369431 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:48.369954 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:48.383342 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 HTTP/1.1 May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:47:48.385215 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.386867 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '62f8cf00-9637-4105-83e7-2ba41eda67a4'} May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:48.387669 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. May 12 15:47:48.389021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:48.390193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance 62f8cf00-9637-4105-83e7-2ba41eda67a4 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:48.390193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-6975ac60-c515-40e5-880e-cb913a3f45a1 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4" status: 404 len: 111 microversion: 2.1 time: 0.036372 May 12 15:47:48.390193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 515/998] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:48 2022] GET /compute/v2.1/servers/62f8cf00-9637-4105-83e7-2ba41eda67a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:47:49.530278 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:49.530819 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:49.537838 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.538343 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.539109 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.539534 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.553500 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 HTTP/1.1 May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:47:49.555026 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.556598 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'c0cfc486-335a-4582-95e3-d5a193d6ea05'} May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:49.557453 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.558862 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.560385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:49.560385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1503f726-3231-4146-8e82-e89b274ba785 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 404 len: 111 microversion: 2.1 time: 0.029967 May 12 15:47:49.560385 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 484/999] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:47:49 2022] DELETE /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:47:49.567702 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:49.568381 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: c0cfc486-335a-4582-95e3-d5a193d6ea05] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:49.578939 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.579551 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.580771 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.581390 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.597345 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 HTTP/1.1 May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:47:49.598985 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.600898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'c0cfc486-335a-4582-95e3-d5a193d6ea05'} May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:49.601908 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. May 12 15:47:49.603406 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.605001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance c0cfc486-335a-4582-95e3-d5a193d6ea05 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:49.605001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-58305b34-7a95-4128-bab7-4403c0468a4e tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05" status: 404 len: 111 microversion: 2.1 time: 0.039144 May 12 15:47:49.605001 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 516/1000] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:49 2022] GET /compute/v2.1/servers/c0cfc486-335a-4582-95e3-d5a193d6ea05 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:47:49.609005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:49.609506 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:49.615920 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.616364 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.617167 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.617599 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.631268 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 HTTP/1.1 May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:47:49.632814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.634517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': 'daf1ffc3-df70-42c7-96e5-b0cca1228030'} May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:49.635557 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.637190 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:49.638852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:49.638852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-0928d087-97c7-4e62-ab01-b027be561d55 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 404 len: 111 microversion: 2.1 time: 0.029025 May 12 15:47:49.638852 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 485/1001] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:47:49 2022] DELETE /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:47:49.642348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:49.642957 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: daf1ffc3-df70-42c7-96e5-b0cca1228030] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:49.648968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.649425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.650191 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:49.650633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:49.664074 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 HTTP/1.1 May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:47:49.665640 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.667768 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': 'daf1ffc3-df70-42c7-96e5-b0cca1228030'} May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:49.668654 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. May 12 15:47:49.669951 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:49.671103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance daf1ffc3-df70-42c7-96e5-b0cca1228030 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:49.671103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-802b34d5-2259-4030-a119-9f6fa6aa71bc tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030" status: 404 len: 111 microversion: 2.1 time: 0.028833 May 12 15:47:49.671103 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 517/1002] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:49 2022] GET /compute/v2.1/servers/daf1ffc3-df70-42c7-96e5-b0cca1228030 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:47:50.811231 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:50.811723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:50.818282 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:50.818732 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:50.819507 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:50.820004 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:50.833993 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.wsgi [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: request: DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b HTTP/1.1 May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept: application/json May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Accept-Encoding: identity May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Connection: close May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Length: 0 May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Content-Type: application/json May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Host: 10.222.0.89 May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Openstack-System-Scope: None May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: User-Agent: python-urllib3/1.26.9 May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Id: None May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Domain-Name: None May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Identity-Status: Confirmed May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Is-Admin-Project: True May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Id: default May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Domain-Name: Default May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Role: member,reader May 12 15:47:50.835655 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Roles: member,reader May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Id: default May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Domain-Name: Default May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: method: > May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: exception: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.837128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: action_args: {'id': '0e13bb6c-6990-4d32-b530-1e11c5125c6b'} May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:50.837946 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.839377 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: ERROR nova.api.openstack.wsgi May 12 15:47:50.841094 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. {{(pid=123633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:50.841094 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-da60ede6-a77e-4674-8dba-a1f39a4b5a51 tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 404 len: 111 microversion: 2.1 time: 0.029772 May 12 15:47:50.841094 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 486/1003] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:47:50 2022] DELETE /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:47:50.845560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:47:50.846202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] [instance: 0e13bb6c-6990-4d32-b530-1e11c5125c6b] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:47:50.852992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:50.853433 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:50.854276 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:47:50.854711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:47:50.868512 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] HTTP exception thrown: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Request method failure captured: May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b HTTP/1.1 May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSskztWknur1CEexg5ASvyTae6sUNih_GwuoF76rZCwMX58n7fXFwLNTwTprzqBOEHCrRgajyeG60nHZle-55zyl6msKaXUKtg9LZJ1f6A2JCxpTqDpFK3LO8rRIklCR8RQfkRawHjMchJg6wfyorGc4i2pmXqR2QAR49uKuH-TvX0o May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:47:50.870065 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_7c7462c1e31649e9849721910b3262a3", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/7c7462c1e31649e9849721910b3262a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 7c7462c1e31649e9849721910b3262a3 May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-407622761 May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: ce1b4eadec3e4c4dae998f154b5966d7 May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-AttachVolumeNegativeTest-407622761-project May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.871718 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '0e13bb6c-6990-4d32-b530-1e11c5125c6b'} May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:47:50.872679 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. May 12 15:47:50.874348 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:47:50.875797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] Returning 404 to user: Instance 0e13bb6c-6990-4d32-b530-1e11c5125c6b could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:47:50.875797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f836cef0-7ed8-4482-905e-00b1468bbcea tempest-AttachVolumeNegativeTest-407622761 tempest-AttachVolumeNegativeTest-407622761-project] 10.222.0.89 "GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b" status: 404 len: 111 microversion: 2.1 time: 0.029811 May 12 15:47:50.875797 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 518/1004] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:47:50 2022] GET /compute/v2.1/servers/0e13bb6c-6990-4d32-b530-1e11c5125c6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:48:44.444700 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-69a304fb-6269-4af2-85bb-3e296c9fbb5f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Action: 'create', calling method: .version_select at 0x7f60d04f6ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-961700797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzQ654W6gSG3JLIRjQ4naexV+Cun5S4gIjlPCGCkInCKV+Hm550S7g/vl1hCNGQry1o5kCqH/q6JpjcB+MWVVi7pKCd7oKBo8aplkMfeHrePFnvnBKDtNkx98F/TGgAxQ=="}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:48:44.459586 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-69a304fb-6269-4af2-85bb-3e296c9fbb5f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Getting quotas for project 8dd6d7add1fa49fba757d057557b5118. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:48:44.463434 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.quota [None req-69a304fb-6269-4af2-85bb-3e296c9fbb5f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Getting quotas for user 5be21e512cf94233af2052026b004edb and project 8dd6d7add1fa49fba757d057557b5118. Resources: {'key_pairs'} {{(pid=123633) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:48:44.491082 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-69a304fb-6269-4af2-85bb-3e296c9fbb5f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050416 May 12 15:48:44.491653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 487/1005] 10.222.0.89 () {60 vars in 1158 bytes} [Thu May 12 15:48:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:48:44.602565 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1787100243", "imageRef": "a42ecfd3-a8c8-42a0-b51a-d018cb23565b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-961700797", "networks": [{"uuid": "ec710b18-76fc-4bea-979c-bb1b0319433d"}]}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:48:44.653783 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.network.neutron [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] validate_networks() for [('ec710b18-76fc-4bea-979c-bb1b0319433d', None, None, None, None, None)] {{(pid=123632) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 15:48:45.137041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Flavor limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 15:48:45.137467 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Image limits 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 15:48:45.137943 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Flavor pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 15:48:45.138351 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Image pref 0:0:0 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 15:48:45.138760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.virt.hardware [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 15:48:45.148032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:45.148517 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:45.149326 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:45.149762 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:45.166520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Getting quotas for project 8dd6d7add1fa49fba757d057557b5118. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 15:48:45.171464 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.quota [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Getting quotas for user 5be21e512cf94233af2052026b004edb and project 8dd6d7add1fa49fba757d057557b5118. Resources: {'instances', 'cores', 'ram'} {{(pid=123632) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 15:48:45.182760 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Going to run 1 instances... {{(pid=123632) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 15:48:45.184929 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a42ecfd3-a8c8-42a0-b51a-d018cb23565b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 15:48:45.230237 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-3aebb9d3-7c1b-4aa4-8e91-82243d2faa7d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631928 May 12 15:48:45.230927 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 519/1006] 10.222.0.89 () {60 vars in 1146 bytes} [Thu May 12 15:48:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 15:48:45.241159 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-326f2fea-b374-47f9-9c87-5fdfcf8a1a4f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:45.242045 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-326f2fea-b374-47f9-9c87-5fdfcf8a1a4f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:45.296651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-326f2fea-b374-47f9-9c87-5fdfcf8a1a4f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:45.303292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-326f2fea-b374-47f9-9c87-5fdfcf8a1a4f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1258 microversion: 2.1 time: 0.066189 May 12 15:48:45.303849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 488/1007] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:45 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:46.321589 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:46.322383 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:46.330884 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:46.332048 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:46.332942 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:46.333443 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:46.415777 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:46.424175 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-5e3721d3-1fe1-47dc-a112-6f29529a66bf tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1328 microversion: 2.1 time: 0.107733 May 12 15:48:46.424967 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 520/1008] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:46 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:47.442003 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:47.442641 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:47.450728 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:47.451614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:47.453004 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:47.453595 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:47.593228 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:47.601633 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9de8448d-881d-45c2-904f-605e36687e9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.163779 May 12 15:48:47.602406 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 489/1009] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:47 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:48.618898 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:48.619487 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:48.626629 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:48.627182 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:48.628070 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:48.628639 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:48.763354 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:48.771802 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4abd76dc-68f7-4f89-a9f1-4dee911c661e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.156842 May 12 15:48:48.772394 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 521/1010] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:48 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:49.789115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:49.789698 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:49.796776 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:49.797237 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:49.798100 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:49.798509 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:49.934083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:49.942068 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-9d034472-28c9-45fe-a8cb-160e66042ef4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.156923 May 12 15:48:49.942661 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 490/1011] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:49 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:50.959450 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:50.960058 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:50.967376 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:50.967843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:50.968807 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:50.969278 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:51.112836 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:51.121193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-19076f58-2f3f-4da6-a3b6-8bcc2db77837 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.165754 May 12 15:48:51.130877 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 522/1012] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:50 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:52.138994 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:52.139814 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:52.146650 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:52.147135 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:52.147943 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:52.148352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:52.283410 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:52.291059 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-2a8d7a88-94c5-4cad-9dcf-773f4c895e50 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.155987 May 12 15:48:52.291634 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 491/1013] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:52 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:53.308722 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:53.309427 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:53.316305 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:53.316896 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:53.317674 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:53.318155 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:53.470827 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:53.481316 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cd375345-fac4-44f0-894d-980f19906fd4 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.176589 May 12 15:48:53.492555 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 523/1014] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:53 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:54.498982 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:54.499615 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:54.506270 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:54.506736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:54.507635 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:54.508104 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:54.702144 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:54.709882 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ae6b082a-0bc9-4868-9a20-b3dd51cfe974 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.214846 May 12 15:48:54.710462 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 492/1015] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:54 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:54.979897 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-3175f098-1b66-407d-903c-50f6d0fe7d8b req-81c8fd40-f013-411a-a94b-0d77769c29ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:48:54.998475 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-3175f098-1b66-407d-903c-50f6d0fe7d8b req-81c8fd40-f013-411a-a94b-0d77769c29ab service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:54.998949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-3175f098-1b66-407d-903c-50f6d0fe7d8b req-81c8fd40-f013-411a-a94b-0d77769c29ab service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:55.010644 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-3175f098-1b66-407d-903c-50f6d0fe7d8b req-81c8fd40-f013-411a-a94b-0d77769c29ab service nova] Creating event network-changed:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:48:55.016178 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-3175f098-1b66-407d-903c-50f6d0fe7d8b req-81c8fd40-f013-411a-a94b-0d77769c29ab service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039999 May 12 15:48:55.017029 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 524/1016] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:48:55.734708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:55.735602 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:55.745593 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:55.746184 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:55.746970 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:55.747399 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:55.887118 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:55.900820 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-dc61e9e2-7cdd-4910-8e61-1e084a72d9ab tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.172533 May 12 15:48:55.901475 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 493/1017] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:55 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:56.928098 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:56.929266 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:56.939506 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:56.939953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:56.940750 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:56.941178 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:57.085575 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:57.093425 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-22419cd1-e6f5-4410-bc89-72899662fdba tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.173180 May 12 15:48:57.093978 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 525/1018] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:56 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:58.111662 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:58.112312 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:58.122665 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:58.123403 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:58.124734 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:58.125992 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:58.282332 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:58.290129 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-eb82580f-a2ff-43ea-9c09-9c85d3b779d6 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.183197 May 12 15:48:58.290708 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 494/1019] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:58 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:48:59.310739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:48:59.311704 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:48:59.320330 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:59.320811 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:59.321592 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:48:59.322034 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:48:59.470024 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:48:59.481470 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-29658989-fbc1-4818-ab3e-c4efb56302a2 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.176634 May 12 15:48:59.482398 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 526/1020] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:48:59 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:00.500306 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:00.501017 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:00.507578 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:00.508039 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:00.508847 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:00.509282 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:00.578677 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-77531a89-229d-468c-ba95-5c054c7a393f req-f1ae5d2c-a115-4609-b97f-59e2250055f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "name": "network-vif-plugged", "status": "completed", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:49:00.586839 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-77531a89-229d-468c-ba95-5c054c7a393f req-f1ae5d2c-a115-4609-b97f-59e2250055f4 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:00.587342 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-77531a89-229d-468c-ba95-5c054c7a393f req-f1ae5d2c-a115-4609-b97f-59e2250055f4 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:00.598213 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-77531a89-229d-468c-ba95-5c054c7a393f req-f1ae5d2c-a115-4609-b97f-59e2250055f4 service nova] Creating event network-vif-plugged:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:49:00.603242 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-77531a89-229d-468c-ba95-5c054c7a393f req-f1ae5d2c-a115-4609-b97f-59e2250055f4 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200686 May 12 15:49:00.603849 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 495/1021] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:49:00.637949 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:00.646456 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0080d10c-5a04-4730-a8a1-80fa595cfa3a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.150080 May 12 15:49:00.647016 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 527/1022] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:00 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:49:01.669524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:01.670696 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:01.681704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:01.682467 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:01.683737 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:01.684492 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:01.819374 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:01.830418 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-5e0c4b14-5f65-41cd-81fc-aec6040a6724 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1358 microversion: 2.1 time: 0.168967 May 12 15:49:01.831136 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 496/1023] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:01 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:02.851744 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:02.852418 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:02.861591 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:02.862212 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:02.863295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:02.863843 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.009841 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:03.020673 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-0cb3eaa0-1243-430f-a971-7fba341e9a27 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1548 microversion: 2.1 time: 0.175548 May 12 15:49:03.021375 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 528/1024] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:02 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:03.039520 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:03.040128 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:03.047146 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:03.047597 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.048352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:03.048812 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.187089 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:03.198345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d704b9ff-b126-46af-b25f-07e254c18406 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1548 microversion: 2.1 time: 0.161843 May 12 15:49:03.198345 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 497/1025] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:03 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:49:03.213476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:03.216833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:03.217582 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Searching by: {'deleted': False, 'project_id': '8dd6d7add1fa49fba757d057557b5118'} {{(pid=123632) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 15:49:03.224953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:03.225396 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.226183 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:03.226616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.316265 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.multi_cell_list [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 15:49:03.407150 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-f9268c4d-fb42-4306-ab8f-636823deffe9 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197422 May 12 15:49:03.407652 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 529/1026] 10.222.0.89 () {58 vars in 1124 bytes} [Thu May 12 15:49:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:49:03.420785 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:03.421491 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:03.428242 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:03.428823 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.429653 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:03.430090 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:03.572051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:03.582607 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-483f7a86-6abb-4653-88c4-0e088e4173c0 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1548 microversion: 2.1 time: 0.167748 May 12 15:49:03.583379 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 498/1027] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:03 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:05.135707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3796d631-bafd-4a49-857f-4ad4afcf79cd"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:49:05.136806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:05.143707 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:05.144170 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:05.145000 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:05.145439 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:05.391540 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-aac6dd8e-1d5e-41c4-a944-9d2228f2595e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259673 May 12 15:49:05.392180 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 530/1028] 10.222.0.89 () {60 vars in 1322 bytes} [Thu May 12 15:49:05 2022] POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:49:11.939559 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:11.940163 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:11.946962 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:11.947408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:11.948179 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:11.948825 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:12.087077 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:12.095066 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-74c7097f-fc1c-405a-801b-6e9bccefe243 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1594 microversion: 2.1 time: 0.159453 May 12 15:49:12.095664 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 499/1029] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:11 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:13.977476 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-520f2207-d96e-4ca0-9627-0ce088adbc9a req-63a36c94-c64a-4980-83d2-31af3a9cab99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:49:13.987734 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-520f2207-d96e-4ca0-9627-0ce088adbc9a req-63a36c94-c64a-4980-83d2-31af3a9cab99 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:13.988177 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-520f2207-d96e-4ca0-9627-0ce088adbc9a req-63a36c94-c64a-4980-83d2-31af3a9cab99 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:14.000677 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-520f2207-d96e-4ca0-9627-0ce088adbc9a req-63a36c94-c64a-4980-83d2-31af3a9cab99 service nova] Creating event network-changed:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:49:14.006063 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-520f2207-d96e-4ca0-9627-0ce088adbc9a req-63a36c94-c64a-4980-83d2-31af3a9cab99 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093354 May 12 15:49:14.007273 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 531/1030] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:49:14.870625 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-493074057"}} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:49:14.871164 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:14.877524 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:14.877981 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:14.879751 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:14.879751 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:15.007498 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.network.security_group_api [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Adding security group 53181777-1593-4599-95ba-842c30310dd2 to port 678f151b-df0c-4f72-b6f1-994f398abe16 May 12 15:49:15.392723 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-582f6b0f-cc90-41cd-a722-d5d558ef6116 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/action" status: 202 len: 0 microversion: 2.1 time: 0.525883 May 12 15:49:15.396517 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 500/1031] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:49:14 2022] POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:49:15.401247 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:15.401687 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-71e56ae8-47c6-4acc-b16e-b6cf2faf4761 req-cbd14df5-f057-445d-900f-ae1b58beddc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:49:15.402134 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:15.411477 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-71e56ae8-47c6-4acc-b16e-b6cf2faf4761 req-cbd14df5-f057-445d-900f-ae1b58beddc8 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:15.412165 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-71e56ae8-47c6-4acc-b16e-b6cf2faf4761 req-cbd14df5-f057-445d-900f-ae1b58beddc8 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:15.413392 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:15.413881 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:15.414685 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:15.415115 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:15.427205 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-71e56ae8-47c6-4acc-b16e-b6cf2faf4761 req-cbd14df5-f057-445d-900f-ae1b58beddc8 service nova] Creating event network-changed:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:49:15.433834 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-71e56ae8-47c6-4acc-b16e-b6cf2faf4761 req-cbd14df5-f057-445d-900f-ae1b58beddc8 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 May 12 15:49:15.436021 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 532/1032] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:49:15.687357 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:15.695382 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-00607985-14a1-4e67-81fc-7e11f8a54775 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1759 microversion: 2.1 time: 0.297854 May 12 15:49:15.695969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 501/1033] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:15 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1759 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:38.375382 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:49:38.376452 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:38.383626 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:38.384081 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:38.384919 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:38.385352 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:38.472205 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-cfdcd42d-221d-43dd-94e5-5ea7c7a9b59f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/action" status: 202 len: 0 microversion: 2.1 time: 0.100694 May 12 15:49:38.473067 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 533/1034] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:49:38 2022] POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:49:38.483681 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:38.484647 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:38.490826 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:38.491279 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:38.492067 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:38.492626 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:38.726979 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:38.735292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-bf37cd4a-c167-46d2-ba4f-e838df3e49f8 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1751 microversion: 2.1 time: 0.256451 May 12 15:49:38.735920 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 502/1035] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:38 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1751 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:39.754988 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:39.755711 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:39.762616 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:39.763071 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:39.763847 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:39.764285 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:39.904403 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:39.913872 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-1101adfa-3ccb-4946-b121-634576ba1323 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.163688 May 12 15:49:39.914478 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 534/1036] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:39 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:40.932124 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:40.932736 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:40.939414 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:40.939866 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:40.940662 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:40.941093 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:41.087235 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:41.095609 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-a0a1c778-38bd-48b0-93c9-a2b66bff729a tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.167507 May 12 15:49:41.096193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 503/1037] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:40 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:42.113772 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:42.114429 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:42.121343 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:42.121799 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:42.122560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:42.122992 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:42.263754 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:42.272136 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d6393e1a-c13f-436a-b27c-497e73ceaf4d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.162416 May 12 15:49:42.272739 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 535/1038] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:42 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:43.292803 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:43.293431 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:43.300367 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:43.300836 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:43.301593 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:43.302022 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:43.444287 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:43.452376 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-bc85ec31-6483-4b45-b736-875d5a085267 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.165298 May 12 15:49:43.452973 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 504/1039] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:43 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:44.472959 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:44.473930 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:44.484238 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:44.485032 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:44.486283 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:44.487033 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:44.658885 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:44.669229 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-68e0ca0f-d483-4947-8593-ed31cc24e8cb tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.202748 May 12 15:49:44.669794 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 536/1040] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:44 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:45.688343 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:45.689086 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:45.698685 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:45.699139 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:45.699914 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:45.700348 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:45.860762 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:45.869196 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-706e0c24-b213-4593-9699-f5b6aa71275c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.185679 May 12 15:49:45.869764 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 505/1041] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:45 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:46.886775 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:46.887353 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:46.894018 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:46.894472 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:46.895232 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:46.895667 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:47.050520 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:47.058851 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-74a9c89e-aeb3-4a5e-9fb6-83a91a61ae17 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.176128 May 12 15:49:47.059428 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 537/1042] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:46 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:48.078292 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:48.079080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:48.087511 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:48.087969 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:48.088782 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:48.089225 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:48.235199 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:48.245831 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-3aab53b0-dc7a-41d5-9908-03999f578878 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.172817 May 12 15:49:48.246440 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 506/1043] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:48 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:49.267295 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:49.268291 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:49.279193 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:49.279968 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:49.281298 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:49.282036 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:49.431925 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:49.439962 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-40d7b2f1-aaa9-4b53-a751-29140b3fee07 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.179129 May 12 15:49:49.440528 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 538/1044] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:49 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:50.461387 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:50.462372 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:50.470743 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:50.471315 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:50.472279 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:50.472871 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:50.622169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:50.634875 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-cf213d65-723d-4de7-a561-a8f2a350c8ac tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.179726 May 12 15:49:50.635649 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 507/1045] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:50 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:51.656279 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:51.657317 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:51.668499 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:51.668956 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:51.669721 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:51.670156 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:51.827246 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:51.836014 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-ec8d0453-b13f-4d14-ba34-05829572eb6c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.186238 May 12 15:49:51.836612 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 539/1046] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:51 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:52.857876 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:52.858753 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:52.869935 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:52.870391 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:52.871169 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:52.871641 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:53.022738 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:53.032087 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-d5704c7f-3865-4ce9-8d54-c4423c651edd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.180970 May 12 15:49:53.032704 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 508/1047] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:52 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:54.051129 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:54.051806 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:54.059173 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:54.059623 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:54.060389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:54.060854 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:54.205023 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:54.213020 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-673bc219-d8af-47d7-a7e7-d8cb7f55fca5 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1756 microversion: 2.1 time: 0.166238 May 12 15:49:54.213660 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 540/1048] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:54 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:49:55.230839 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:49:55.231530 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:49:55.238080 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:55.238525 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:55.239295 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:49:55.239727 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:49:55.388647 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:49:55.396699 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-1a116aea-e912-4871-bec9-46aed6c24afd tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1759 microversion: 2.1 time: 0.170137 May 12 15:49:55.397277 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 509/1049] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:49:55 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:50:25.063922 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:50:25.064716 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:50:27.506531 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-493074057"}} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:50:27.507901 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:27.515812 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:27.516269 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:27.517078 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:27.517498 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:27.646522 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.network.security_group_api [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Removing security group 53181777-1593-4599-95ba-842c30310dd2 from port 678f151b-df0c-4f72-b6f1-994f398abe16 May 12 15:50:28.031560 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-500f6577-8749-4afc-b163-a01cc031147e tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/action" status: 202 len: 0 microversion: 2.1 time: 0.531654 May 12 15:50:28.032815 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 541/1050] 10.222.0.89 () {60 vars in 1277 bytes} [Thu May 12 15:50:27 2022] POST /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:50:28.041154 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [req-41ead473-ae25-4be0-9b55-972ec0b7eb6b req-c5f008bb-f4e0-41ad-8c38-59ded511c5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:50:28.050005 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-41ead473-ae25-4be0-9b55-972ec0b7eb6b req-c5f008bb-f4e0-41ad-8c38-59ded511c5bc service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:28.051083 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [req-41ead473-ae25-4be0-9b55-972ec0b7eb6b req-c5f008bb-f4e0-41ad-8c38-59ded511c5bc service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:28.070482 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.compute.server_external_events [req-41ead473-ae25-4be0-9b55-972ec0b7eb6b req-c5f008bb-f4e0-41ad-8c38-59ded511c5bc service nova] Creating event network-changed:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:50:28.090008 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [req-41ead473-ae25-4be0-9b55-972ec0b7eb6b req-c5f008bb-f4e0-41ad-8c38-59ded511c5bc service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052477 May 12 15:50:28.091436 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 510/1051] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:50:29.678780 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:29.679303 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:29.685886 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:29.686336 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:29.687108 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:29.687537 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:29.769122 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.objects.instance [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lazy-loading 'services' on Instance uuid 3ef0657a-0d69-4149-b3e8-690c03a82439 {{(pid=123632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:50:29.839934 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-e5de605e-a780-4ed1-adb1-c996d72a89ca tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments/3796d631-bafd-4a49-857f-4ad4afcf79cd" status: 202 len: 0 microversion: 2.1 time: 0.165787 May 12 15:50:29.840633 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 542/1052] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:50:29 2022] DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments/3796d631-bafd-4a49-857f-4ad4afcf79cd => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:50:29.850343 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:29.851350 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:29.858408 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:29.859051 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:29.859863 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:29.860690 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:30.055790 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-27dbaf9f-ae4f-4d43-8e41-0028a001b5d3 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210297 May 12 15:50:30.056251 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 511/1053] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:50:29 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:50:30.114892 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-07f47afd-d955-44b8-8e2e-e815b52f540a req-990c8766-9746-449b-8825-6340b0c20068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:50:30.123673 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-07f47afd-d955-44b8-8e2e-e815b52f540a req-990c8766-9746-449b-8825-6340b0c20068 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:30.124114 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-07f47afd-d955-44b8-8e2e-e815b52f540a req-990c8766-9746-449b-8825-6340b0c20068 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:30.135287 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-07f47afd-d955-44b8-8e2e-e815b52f540a req-990c8766-9746-449b-8825-6340b0c20068 service nova] Creating event network-changed:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:50:30.140490 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-07f47afd-d955-44b8-8e2e-e815b52f540a req-990c8766-9746-449b-8825-6340b0c20068 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029556 May 12 15:50:30.141059 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 543/1054] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:50:31.070320 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:31.071642 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:31.079651 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:31.080102 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:31.080924 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:31.081358 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:31.111857 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-910b4b8e-1442-4695-900c-e4e867589d04 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047915 May 12 15:50:31.112443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 512/1055] 10.222.0.89 () {58 vars in 1301 bytes} [Thu May 12 15:50:31 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 15:50:31.127200 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:31.127790 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:31.137623 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:31.138077 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:31.138848 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:31.139280 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:31.413953 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] HTTP exception thrown: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 is not attached to volume 3796d631-bafd-4a49-857f-4ad4afcf79cd May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Request method failure captured: May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments/3796d631-bafd-4a49-857f-4ad4afcf79cd HTTP/1.1 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSxO4lDpvabPQxqZKj-zTt8CUgPo_Hj8a4TNamlo8UqS1JOq311F2CdNBR_c0qA3jttNqO1uZkMLZ9Dbg7leP_Dl7tIV0w77uHu3t4ym7X94XxAOF0JC-OdAJcUr6tjsgH7T5Hn0qIAQv_TY5ha5QDGoahu2EpIPGueXsX0H1yCPYp4 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8dd6d7add1fa49fba757d057557b5118 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-TestMinimumBasicScenario-285067451 May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:50:31.422599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8dd6d7add1fa49fba757d057557b5118", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8dd6d7add1fa49fba757d057557b5118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8dd6d7add1fa49fba757d057557b5118"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8dd6d7add1fa49fba757d057557b5118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-TestMinimumBasicScenario-285067451 May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8dd6d7add1fa49fba757d057557b5118 May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-TestMinimumBasicScenario-285067451 May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-TestMinimumBasicScenario-285067451-project May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 5be21e512cf94233af2052026b004edb May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-TestMinimumBasicScenario-285067451-project May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:50:31.424217 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 is not attached to volume 3796d631-bafd-4a49-857f-4ad4afcf79cd May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'server_id': '3ef0657a-0d69-4149-b3e8-690c03a82439', 'id': '3796d631-bafd-4a49-857f-4ad4afcf79cd'} May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3796d631-bafd-4a49-857f-4ad4afcf79cd. May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:50:31.425363 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 is not attached to volume 3796d631-bafd-4a49-857f-4ad4afcf79cd May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 is not attached to volume 3796d631-bafd-4a49-857f-4ad4afcf79cd May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:31.427668 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Returning 404 to user: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 is not attached to volume 3796d631-bafd-4a49-857f-4ad4afcf79cd {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:50:31.429809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-10301962-b584-4192-946c-a100d53dae9d tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments/3796d631-bafd-4a49-857f-4ad4afcf79cd" status: 404 len: 154 microversion: 2.1 time: 0.304933 May 12 15:50:31.429809 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 544/1056] 10.222.0.89 () {58 vars in 1415 bytes} [Thu May 12 15:50:31 2022] DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439/os-volume_attachments/3796d631-bafd-4a49-857f-4ad4afcf79cd => generated 154 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:50:32.577519 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:32.578053 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:32.584902 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:32.585352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:32.586124 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:32.586562 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:32.610717 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Going to try to terminate instance {{(pid=123633) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 15:50:32.691352 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-ac86083e-8417-4708-95e0-bf69516bc0df tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 204 len: 0 microversion: 2.1 time: 0.117527 May 12 15:50:32.691991 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 513/1057] 10.222.0.89 () {58 vars in 1238 bytes} [Thu May 12 15:50:32 2022] DELETE /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:50:32.700510 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:32.701137 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:32.707706 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:32.708158 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:32.708995 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:32.709424 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:32.840428 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.policy [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123632) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:50:32.848445 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-4158c326-9fa8-4974-8514-abb67af0e258 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1554 microversion: 2.1 time: 0.152037 May 12 15:50:32.849041 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 545/1058] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:50:32 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 15:50:33.871470 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:33.872383 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:33.881062 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:33.881661 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:33.882690 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:33.883267 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:34.027283 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:50:34.035185 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-b2ee70cb-33c2-4d6d-9ab9-847fe34c219f tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1554 microversion: 2.1 time: 0.171097 May 12 15:50:34.035758 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 514/1059] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:50:33 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:50:34.762599 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [req-1e79da74-377d-447f-884f-51dc9b86a3be req-53eff493-ad4f-419d-adeb-7917ba48f291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ef0657a-0d69-4149-b3e8-690c03a82439", "name": "network-vif-deleted", "tag": "678f151b-df0c-4f72-b6f1-994f398abe16"}]} {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:50:34.772202 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1e79da74-377d-447f-884f-51dc9b86a3be req-53eff493-ad4f-419d-adeb-7917ba48f291 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:34.772697 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [req-1e79da74-377d-447f-884f-51dc9b86a3be req-53eff493-ad4f-419d-adeb-7917ba48f291 service nova] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:34.784618 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.compute.server_external_events [req-1e79da74-377d-447f-884f-51dc9b86a3be req-53eff493-ad4f-419d-adeb-7917ba48f291 service nova] Creating event network-vif-deleted:678f151b-df0c-4f72-b6f1-994f398abe16 for instance 3ef0657a-0d69-4149-b3e8-690c03a82439 on hv-cinder-83588 May 12 15:50:34.789581 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [req-1e79da74-377d-447f-884f-51dc9b86a3be req-53eff493-ad4f-419d-adeb-7917ba48f291 service nova] 10.222.0.89 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 May 12 15:50:34.790281 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 546/1060] 10.222.0.89 () {64 vars in 1317 bytes} [Thu May 12 15:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:50:35.053938 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:35.054553 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.compute.api [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123633) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:35.061734 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:35.062447 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:35.063445 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:35.064193 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:35.096567 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:35.097024 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG oslo_concurrency.lockutils [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:35.097482 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.objects.instance [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lazy-loading 'fault' on Instance uuid 3ef0657a-0d69-4149-b3e8-690c03a82439 {{(pid=123633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 15:50:35.142443 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.policy [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be21e512cf94233af2052026b004edb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dd6d7add1fa49fba757d057557b5118', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123633) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:50:35.155091 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-70e9ccd9-30fa-4139-b0c5-091b0f8cf894 tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 200 len: 1348 microversion: 2.1 time: 0.105191 May 12 15:50:35.155676 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 515/1061] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:50:35 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:50:36.178366 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '>' {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:36.179503 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.compute.api [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] [instance: 3ef0657a-0d69-4149-b3e8-690c03a82439] Fetching instance by UUID {{(pid=123632) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 15:50:36.187905 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:36.188355 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:36.189161 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 15:50:36.189596 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG oslo_concurrency.lockutils [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Lock "f87d5b30-e042-4499-b98c-f99906a2836c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 15:50:36.203188 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.wsgi [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] HTTP exception thrown: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 could not be found. May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Request method failure captured: May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: request: GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 HTTP/1.1 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept: application/json May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Accept-Encoding: identity May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Connection: close May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Length: 0 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Content-Type: application/json May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Host: 10.222.0.89 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Openstack-System-Scope: None May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: User-Agent: python-urllib3/1.26.9 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Auth-Token: gAAAAABifSxO4lDpvabPQxqZKj-zTt8CUgPo_Hj8a4TNamlo8UqS1JOq311F2CdNBR_c0qA3jttNqO1uZkMLZ9Dbg7leP_Dl7tIV0w77uHu3t4ym7X94XxAOF0JC-OdAJcUr6tjsgH7T5Hn0qIAQv_TY5ha5QDGoahu2EpIPGueXsX0H1yCPYp4 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Id: None May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Domain-Name: None May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Identity-Status: Confirmed May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Is-Admin-Project: True May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Id: default May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Domain-Name: Default May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Id: 8dd6d7add1fa49fba757d057557b5118 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Project-Name: tempest-TestMinimumBasicScenario-285067451 May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Role: member,reader May 12 15:50:36.204863 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Roles: member,reader May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89:8080/v1/AUTH_8dd6d7add1fa49fba757d057557b5118", "adminURL": "http://10.222.0.89:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/compute/v2/8dd6d7add1fa49fba757d057557b5118"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8dd6d7add1fa49fba757d057557b5118"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/volume/v3/8dd6d7add1fa49fba757d057557b5118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.89/image"}]}] May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant: tempest-TestMinimumBasicScenario-285067451 May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Id: 8dd6d7add1fa49fba757d057557b5118 May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-Tenant-Name: tempest-TestMinimumBasicScenario-285067451 May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User: tempest-TestMinimumBasicScenario-285067451-project May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Id: default May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Domain-Name: Default May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Id: 5be21e512cf94233af2052026b004edb May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: X-User-Name: tempest-TestMinimumBasicScenario-285067451-project May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: method: > May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: exception: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 could not be found. May 12 15:50:36.206492 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: action_args: {'id': '3ef0657a-0d69-4149-b3e8-690c03a82439'} May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: {{(pid=123632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 could not be found. May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 15:50:36.207389 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 could not be found. May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 could not be found. May 12 15:50:36.208808 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: ERROR nova.api.openstack.wsgi May 12 15:50:36.210045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: DEBUG nova.api.openstack.wsgi [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Returning 404 to user: Instance 3ef0657a-0d69-4149-b3e8-690c03a82439 could not be found. {{(pid=123632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 15:50:36.210045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO nova.api.openstack.requestlog [None req-d8854b5e-cacd-4d88-8deb-818bbb69ef0b tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439" status: 404 len: 111 microversion: 2.1 time: 0.035682 May 12 15:50:36.210045 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: [pid: 123632|app: 0|req: 547/1062] 10.222.0.89 () {58 vars in 1235 bytes} [Thu May 12 15:50:36 2022] GET /compute/v2.1/servers/3ef0657a-0d69-4149-b3e8-690c03a82439 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:50:36.215194 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: DEBUG nova.api.openstack.wsgi [None req-af12e8c0-a2cb-45e0-b9cf-18acdbd8655c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] Calling method '.version_select at 0x7f60d05a7040>' {{(pid=123633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:50:36.235614 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO nova.api.openstack.requestlog [None req-af12e8c0-a2cb-45e0-b9cf-18acdbd8655c tempest-TestMinimumBasicScenario-285067451 tempest-TestMinimumBasicScenario-285067451-project] 10.222.0.89 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-961700797" status: 202 len: 0 microversion: 2.1 time: 0.024396 May 12 15:50:36.236171 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: [pid: 123633|app: 0|req: 516/1063] 10.222.0.89 () {58 vars in 1268 bytes} [Thu May 12 15:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-961700797 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:52:00.627933 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:52:00.628833 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:52:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:52:16.976391 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:52:16.977320 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Thu May 12 15:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:53:45.074179 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:53:45.075297 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:53:45.838087 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:53:45.838960 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Thu May 12 15:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:55:20.642688 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:55:20.643659 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:55:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:55:36.159993 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:55:36.161234 dv-cinder-835881-11-iscsi devstack@n-api.service[123632]: Thu May 12 15:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:55:36.990362 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:55:36.991294 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Thu May 12 15:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:55:46.329786 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:55:46.330810 dv-cinder-835881-11-iscsi devstack@n-api.service[123633]: Thu May 12 15:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!